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|. Introduction 


Educators raise concerns about what happens to students when they are exposed to new 
teachers or teachers who are new to a school. These teachers face the challenge of preparing a year’s 
worth of new material, perhaps in an unfamiliar work environment. However, even when teachers 
remain in the same school they can switch assignments—teaching either a different grade or a different 
subject than they have taught before. While there exists some quasi-experimental literature on the 
effects for student achievement of being new to the profession (e.g., Rockoff, 2004) or to a school 
(Hanushek & Rivkin, 2010), to date there is little evidence about how much within-school churn typically 
happens and how it affects students. We use longitudinal panel data from New York City from 1974 to 
2010 to document the phenomenon, and we tie assignment-switching behaviors to available student 
achievement in the period since 1999. 

We find that in any given year, students are nearly four times more likely to be assigned to a 
teacher who has undergone a within-school assignment switch than a teacher who is new to teaching. 
We also document that, on average in New York City each year, over forty percent of teachers are new 
to their post in one of the following ways: new to the profession, new to New York City (transferred 
from another district), new to their school, or in the same school but new to their subject/grade 
assignment. Given this notable rate at which teachers are new to their positions in some way, we use a 
variety of fixed effects approaches to estimate the link between student achievement and these various 
forms of being to new one’s job assignment. We particularly focus on within-school switches given that 
we find that over half of all switches are of this type and we know so little about how students are 


affected by it. 


ll. Background 


As with most professions, on average teachers exhibit returns to experience particularly during 
the early career (Atteberry, Loeb, & Wyckoff, Conditional Accept; Boyd, Lankford, Loeb, Rockoff, & 
Wyckoff, 2008; Clotfelter, Ladd, & Vigdor, 2007; Harris & Sass, 2011; Ost, 2009; Papay & Kraft, 2011; 
Rivkin, Hanushek, & Kain, 2005; Rockoff, 2004). Teachers likely improve over time because they gain 
familiarity and fluency both with the act of teaching itself, as well as the interpersonal demands of the 
profession. However many factors are correlated with how much teachers improve over time, including 
prior training and pathway into the profession (Boyd, Grossman, Lankford, Loeb, & Wyckoff, 2009; Kane, 
Rockoff, & Staiger, 2008), on-the-job professional development (Yoon, 2007), the strength of school 
leadership (Boyd et al., 2011; Grissom, 2011), the quality of professional networks within schools 
(Atteberry & Bryk, 2010), the effectiveness of grade-level peers (Jackson & Bruegmann, 2009), and 
school socio-environmental factors including trust, peer collaboration, and shared decision-making (Bryk 
& Schneider, 2002; Bryk, Sebring, Allensworth, Luppescu, & Easton, 2010; Kraft & Papay, 2014). 
Developing access to many of these resources—or reaping the benefits of them—often takes time. 
Trust, for instance, is an iterative and long-term discernment process through which actors judge one 
another's intentions and worthiness of trust (Bryk & Schneider, 2002). When teachers are brand new to 
the profession, to a school, or even to a particular working group within a school, they may need to re- 
establish their connection to these resources. Along those same lines, Ronfeldt, Loeb, and Wyckoff 
(2013) hypothesized that the negative relationship they observe between high rates of new-to-school 
teachers and achievement could be explained by the disruption of working norms. Given that teacher 
improvement may be associated with these local conditions, we therefore begin by considering the 
reasons that teachers switch schools and roles, potentially disrupting their development. 

Why might teachers switch jobs within schools? First, teachers may be relatively more effective 


in one position than another, and either school leaders or the teachers themselves may seek to optimize 


the matches of teachers to jobs. Second, some jobs may simply be more appealing, and teachers may 
vie for these positions. Finally, new demands such as differential enrollments across student cohorts, 
new courses, or difficulty hiring for particular positions may necessitate reassignment even if neither 
leaders nor teachers would otherwise seek such reassignment. 

Of these three reasons, the first—more optimal matching—might lead to improved outcomes. 
Either principals or teachers might instigate these changes. In order for principals to re-assign teachers 
strategically, they must understand differences in the quality of their teachers and be able to act on that 
knowledge. Extant research provides evidence that many principals do have the ability to discern 
differences in teacher quality (Jacob & Lefgren, 2008; Rockoff, Staiger, Kane, & Taylor, 2012), and 
furthermore that some principals actively use reassignments strategically to achieve their goals (Chingos 
& West, 2011; Cohen-Vogel, 2011; Grissom, Kalogrides, & Loeb, 2013). These authors conclude that 
school leaders are attempting to better match teachers to available vacancies. For example, teachers 
report that principals are more involved in the assignment of teachers to tested grades than to other 
grades, and teachers whose students have lower test score gains are more likely to move away from 
tested grades (Grissom, Kalogrides, & Loeb, 2014). The other two reasons for within-school churn— 
teachers seeking more desirable positions or due to other changes in the school—do not necessarily 
have benefits for students. 

One can think of “newness” on a continuum. One’s job can be entirely new (as is the case in the 
first year in the profession), the job assignment can be virtually identical from one year to the next, or it 
can be somewhere in the middle with some aspects of the job—but not others—new to the individual at 
a given point in time. Changes in the “what” and “where” of a job may re-introduce some newness back 
into the work. 

While most research on teacher experience has examined the effect on students of having a 


teacher who is new to the profession (see Hanushek and Rivkin (2006) for a review), teachers who are 


new to a district or school might also face challenges. When a teacher moves to a new school to teach 
the same class, many aspects of the work will remain the same, including the developmental age of the 
students and the general curricular content. However the teacher may need to make meaningful 
changes to instructional materials either to suit a new population of students, or to integrate with the 
general strategies that are used in the new school. Further, the social norms of the school are new to 
her, and it may require time and energy to learn how to navigate a new system and/or work with new 
colleagues. Surprisingly little evidence exists on the impact of being assigned to a new-to-school teacher. 
Because being new-to-school involves less unfamiliarity than being new to the profession, the average 
effect of a cross-school reassignment on student achievement may be negative, but less so than the 
effect of being a first year teacher. 

Similarly, being switched to a new assignment within the same school may also reintroduce 
some novelty into the work of a teacher. Sometimes moving involves a grade-only shift (e.g., teaching 
third grade to fourth grade), a subject switch (e.g., switching from teaching social studies to English 
language arts), or both (e.g., fifth grade math to eighth grade science). Being new to one’s specific job 
assignment within the same school may also be challenging for teachers, though perhaps less so than 
being new to the profession, the district, or the school. While such a teacher would continue to possess 
institutional knowledge and working relationships within the school, the teacher may need to become 
familiar with a new grade-level or subject-specific curriculum. She may also find herself working with a 
new set of grade- or subject-specific colleagues. On a daily basis, a new-to-assignment teacher may need 
to create new lesson plans and/or use existing materials that were previously unfamiliar. The “newness” 
of these annual within-school switches may cause teachers to be temporarily less effective, and 
students assigned to switching teachers may exhibit lower achievement than had they been assigned to 


a teacher who taught in the exact same school-subject-grade the previous year. 


We therefore hypothesize that the most challenging form of being new to assignment is being 
entirely new to the profession, followed by teachers who are new the district (but not to teaching) and 
cross-school moves, and finally we hypothesize that within-school reassignments are negative but less 
so than the other forms. It is worth noting, however, that even if within- and between-school 
reassignments are initially associated with decrements to student achievement in the year of the switch, 
it is possible that the teachers are ultimately moving into positions that suit them better (i.e., the 
optimal matching scenario). If this were true, then we would expect that teachers’ effectiveness in years 
following a reassignment would rise above their observed effectiveness in the year(s) prior to the move. 
Initial decrements to effectiveness may be outweighed by longer-term student achievement 
improvements if teachers are systematically moving into positions in which they excel—a possibility we 
also explore in this paper. 

To better understand within-school churning, this study addresses three research questions: 

1. How often and at what points in their career do teachers switch school-, subject-, and/or grade- 
level assignments? 

2. Are students who belong to historically underserved groups (i.e., non-white, low socioeconomic 
status, non-native English speakers) more likely to be assigned to teachers who are new to 
subject-grade, school, or the profession? 

3. What is the impact on student achievement of being assigned to teachers who are new to their 


school, subject, and/or grade assignment? 


lll. Data and Sample 


The data for this analysis are administrative records from a range of databases provided by the 
New York City Department of Education (NYCDOE) and the New York State Education Department 


(NYSED). The NYCDOE data include information on teacher race, ethnicity, experience, school 


assignment, links to the students and classroom(s) in which the teacher taught each year,’ and student 
achievement data.” The student data also include measures of sex, ethnicity, free-lunch status, special- 
education status, number of absences and suspensions in each year for each student who was active in 
any of grades three through eight in a given year. 

The NYSED also collects information from all public education employees through an annual 
survey and maintains a database called the Personnel Master File (PMF) which records information 
about job assignments, percentage of time allocated to each position, annual salary, age, gender, and 
experience. The PMF covers the time period from 1974 to 2010 (with the exception of the 2003 school 
year), and contains unique employee identifiers that can be linked to data on student achievement and 
schools in New York City. 

Defining teacher transitions can be difficult because often researchers do not have complete 
information on the set of vacancies that need to be filled each year. Instead, we observe a series of 
yearly snapshots of teacher job placements at a given point in time based on the New York State PMF 


files.2 We describe our approach in detail in Appendix A, but briefly summarize it here. When a teacher 


' Only in 1999 through 2010 in tested subjects and grades. 

2 New York City students take achievement exams in math and English Language Arts (ELA) in grades three 
through eight. All the exams are aligned to the New York State learning standards and each set of tests is scaled to 
reflect item difficulty and are equated across grades and over time. Tests are given to all registered students with 
limited accommodations and exclusions. Thus, for nearly all students the tests provide a consistent assessment of 
achievement from grade three through grade eight. For most years, the data include scores for 65,000 to 80,000 
students in each grade. We standardize all student achievement scores by subject, grade and year to have a mean of 
zero and a unit standard deviation. 

3 Since all data on teacher annual subject, grade, and school assignments is derived from the PMF file, it is worth 
describing how that data is collected. The PMF system has been in place in New York State for over 40 years. Each 
year in October, teachers and principals throughout the state work together to complete a person-specific survey that 
covers basic information about teachers’ experience, salary, qualifications, and teaching assignments. Both teaching 
and non-teaching staff complete a form every year. The process for completing the PMF has changed over time: In 
earlier years, physical surveys were distributed to individual schools, while in more recent years, an online system is 
used (called the ePMF). The process begins with the administrators in each school initially identifying the primary 
assignments of all school faculty members. Individual teachers are then asked to check and review the assignments 
initially entered by school administrators. Teachers are given extensive training and resources to complete the PMF 
in a consistent manner across districts and schools years. (See for example this training manual: 
http://www.p12.nysed.gov/irs/beds/2014/PMF/documents/ePMFTeachingManualUserGuide201516.pdf). Teachers 
do not “write in” the name of the courses they teach. Instead, they select from a defined list of possible assignment 
descriptions. Those assignment descriptions change somewhat from year to year, however in the most recent year, 
staff members could select from among 82 pre-populated categories of assignment options (with the option to 


is classified as having a different subject-grade-school assignment in a given year than in the previous 
year, we refer to this as a “switch” or “reassignment.” We focus on four mutually exclusive switch types: 
(1) teachers who are new to their position because they are entirely new to the profession; (2) teachers 
who are new to New York City but not new to the profession; (3) teachers who appear in a different 
New York City school in year y versus y-1; and (4) within-school switches—teachers who are in the same 
school but in a different subject and/or grade from year y-1 to year y. Many teachers, especially those in 
middle school, have multiple assignments. To be classified as experiencing a within-school switch, the 
teacher must have a different primary (i.e., greatest percentage of their time) subject- and/or grade- 
level assignment than the previous year in the same school (again, see Appendix A for a complete 
discussion of how primary subject and grades were identified, as well as complications arising from 


ambiguous or missing information). 


Population and Analytic Sample 


The overall population for this paper is the set of New York City employees who were ever 
classroom teachers in traditional public schools (i.e., non-charters) between 1974 and 2010 (271,492 
unique teachers with over 2.4 million teacher-year observations—see row 1 on the left-hand side of 
Table 1). When examining impacts on student outcomes, we narrow the focus to teachers linked to 
student achievement outcomes—that is, those present in 1999 through 2010 in grades three through 
eight (179,037 unique teachers with 1 million teacher year-observations—right-hand side of Table 1). 

In our analyses, we exclude data from 2003 and 2004 due to an idiosyncratic problem with the 
teacher PMF file in 2003 (row 2 of Table 1). We also must limit the sample to the set of person-years in 
which we can observe an employee’s switch status. In order to identify a switch in a given school year, 


we must observe the subject or assignment type for person p in years y (current) and y-1 (prior), the 


specify and describe “other” if no category satisfactorily described their course). At the end of the PMF collection 
period, school leaders are asked to once more review and correct PMF data before the data are collected and 
consolidated at the state level. 
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grade level (if applicable) in both years, the school of record in both years, each person’s current years 
of experience in order to identify teachers who are new, and years of experience within the district in 
order to identify teachers who are new to New York City. We are missing data on subject and/or grade 
assignment data for a subset of observations in the PMF (see row 3 of Table 1). Finally, as alluded to 
above, a teacher’s primary teaching assignment can be ambiguous, because her time may be divided 
equally among several classrooms. In these cases, it is not possible to determine whether a genuine 
switch has occurred since a single, definitive subject-grade assignment cannot be identified, and we lose 
some additional observations (see row 4 of Table 1).* In sum, due to these various data limitations, we 
lose a total of 18.7 percent of the teacher-year observations in the 1974+ sample, however that 
translates into only 1.3 percent of the unique teachers in that sample since most teachers had at least 
one observed switch. In the 1999+ sample, we lose 22.6 percent of teacher-years to these various data 
limitations (the loss of 2003 and 2004 is disproportionately felt in this time frame), but again only 2 


percent of the unique teachers from this time period (see row 4 of Table 1).° 


IV. Methods 


Research Question 1 


For our first research question, we present descriptive statistics about the frequency of switch 
types across teacher-years. We also examine the timing of within-school switches throughout the 
average teacher’s early career. This allows us to determine whether being re-assigned within schools is 


something that only some teachers experience or that virtually all teachers undergo, and whether it 


4 Again, see Appendix A for a complete discussion of the approach used to define subject-grade assignments. 

> Unfortunately, we have almost no time-varying teacher covariates at our disposal that would allow us to examine 
whether the full sample of teacher-year observations is observationally similar to the more restricted sample of 
teacher-years with clear switch statuses. However, we did examine whether there are any differences in these 
samples in terms of unique teachers with and without switch statuses in terms of their time-invariant characteristics 
(e.g., teacher sex, ethnicity, pathway into teaching, competitiveness of undergraduate institution, SAT scores). 
However since most teachers have at least one switch status in some observed year, we lose less than 2 percent of all 
unique teachers due to missing switch statuses, and there are no meaningful differences on these observed 
covariates. 
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tends to happen more than once in the career. This will be germane to a subsequent analysis in which 
we examine the impact of a teacher’s initial switch on not only next year’s outcomes, but also for 


subsequent years before she switches a second time. 


Research Question 2 


For our second research question, we assess whether students who belong to historically 
underserved groups (i.e., non-white, low socioeconomic status, non-native English speakers) are more 
likely to be assigned to teachers who are new to subject-grade, school, district, or the profession. An 
existing body of research has shown that students have differential access to teachers of differing levels 
of experience, value-added scores, and qualifications (Clotfelter, Ladd, & Vigdor, 2005; Goldhaber, 
Lavery, & Theobald, 2015; Isenberg et al., 2013; Kalogrides & Loeb, 2013; Kalogrides, Loeb, & Béteille, 
2013). Since some of this sorting exists within schools as well (see e.g., the work by Kalogrides and Loeb 
(2013) in particular), one might also expect to see uneven assignment to teachers who are new to the 
profession/district/school/assignment, both within and between schools. Should we subsequently find 
that switching has a negative impact on student achievement, the answer to this question would 
provide evidence on the equality of educational opportunities within and across schools. 

We are also interested in whether teachers who are new to their assignment in a given year 
tend to have other characteristics (in terms of the students they serve, their own characteristics, or the 
kinds of schools they work in) that might bias estimates of the effect of being new-to-assignment on 
student achievement if not accounted for in the estimation approach. It is difficult to establish a causal 
link between switching behaviors (new to teaching, a school, or a subject-grade assignment) and student 
achievement since many factors could be associated with both switching and student achievement. A 
few examples may prove useful here. For students within the same schools, teachers with more 
seniority often have more discretion in terms of the kinds of students and classes they teach. If more 


senior teachers can select to work with less challenging students and are also less likely themselves to 
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change assignments, more challenging students may be systematically more likely to be exposed to 
switching teachers who are in turn more likely to be novice. At the teacher level, principals may try to 
move their struggling teachers around in order to find a better “fit.” Again, here we can imagine how a 
selection problem arises if struggling teachers also tend to experience more switching. In this scenario, 
reassignments would appear to be associated with lower student performance, but in fact the prior low 
performance is the cause of the reassignment, not the effect. Finally, at the school level, we know from 
prior work that teachers tend to leave schools serving disadvantaged and minority students at higher 
rates (Boyd, Lankford, Loeb, & Wyckoff, 2003). When teachers leave at higher rates, schools are likely to 
have to move teachers around and hire more novice teachers in order to replace them. Switch rates 
thus may be higher in schools serving disadvantaged students, but it is often difficult to disentangle the 
impact of the switching itself from the fact that it happens more in schools that are likely to have lower 
student achievement for reasons unrelated directly to the churning. We explore these hypotheses to 
examine whether students, teachers, or schools might “select into” within-school churn at higher rates. 

To estimate individual students’ probabilities of being assigned to a teacher who is new to her 
primary school-subject-grade assignment in a given year, we run three separate linear probability 
models for teacher-year level binary outcomes for each of four specific teacher switch types: (1) Teacher 
p switches subject-grade within same school or not (“NewToAssigny,”); (2) the teacher switches from 
another school or not (“NewToSchy,”); (3) the teacher switches from another district or not 
(“NewToDistyy”); and (4) teacher is brand new to teaching or not (“NewTchr,y”). Equation (1) shows 
the generic model for the first of these three outcomes: 

NewToAssignyy = Bo + (X)B + Wiy)B + Eingsy (1) 

We predict students’ assignment to teachers undergoing each of these three kinds of switches 

as a function of a vector of time-invariant student-level characteristics (“X;”) comprised of student sex, 


race/ethnicity, and an indicator of whether the student’s home language is English, as well as time- 
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varying characteristics (“Wiy”) including eligibility for the Free-/Reduced-Price Lunch program, the 
student’s current ELL status, the number of absences and suspensions for the given student in a the 
prior year, as well as the student’s standardized achievement (averaged across math and ELA) in the 
prior year. We conduct these analyses both with and without school fixed effects to explore whether 
any observed association between student characteristics and exposure to re-assigned teachers is 
related to cross-school sorting or occurs even within the same school. We conduct the analyses with all 
student characteristics included together in a single model, as well as sequentially (i.e., with each 
mutually-exclusive set of student categories as the sole regression predictors). The former version 
allows us to explore whether significant differences in assignment to the treatment of interest remain 
after the inclusion of all observed confounding variables. If so, this may guide us to prefer certain 
specifications of the subsequent fixed effects regressions. On the other hand, by examining student 
predictors one at a time, we can address the question of whether any negative estimated impacts are 
likely to be disproportionately experienced by students of color, of low socioeconomic status, or for 
students who are English language learners. 

In the same vein, we explore whether certain kinds of teachers are more likely to churn (or be 
churned). We focus on within-school churns (“NewToAssigny,y”) as the outcome of interest in Equation 
(2): 

NewToAssignyy = Bo + (Ty )B + B(Expyy) + [B(PriorVApy)] + Etsy (2) 

We predict a teacher’s probability of churning as a function of a set of time-invariant teacher- 

level characteristics (“T,”) comprised of teacher demographics (sex and race/ethnicity), information 


about teacher preparation (SAT scores, competitiveness of undergraduate institution, and pathway into 
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teaching, as well as teachers’ time-varying years of experience® (Exppy) and, in some models, prior year 
value-added scores (PriorVA,,). 

Finally, we explore the possibility that certain kinds of schools engage in more teacher within- 
school churning than others. We calculate the churn rate for each school in each year (i.e., the 
percentage of the faculty in the given year who were teaching in the same school but in a different 
subject or grade in the previous year). Because churn rates in a given year may be somewhat unstable, 
we take the mean for each school across three years (2006-07 through 2008-09) and predict this mean 
within-school churn rate as a function of average school characteristics during the same time period. We 
can see whether, for instance, schools serving disadvantaged populations have less stability in teaching 
assignments from one year to the next. Again this is relevant for thinking about what potential 
confounding factors may be associated with both the treatment of interest (switching into a new 


assignment) and the outcome, student achievement. 


Research Question 3 


Ultimately, we are interested in whether the pervasive phenomenon of teacher 
reassignments—the three kinds of switches—appear to have a positive or negative impact on student 
achievement. Here we necessarily restrict our analysis to teacher-year observations linked to student 
achievement, and as such the sample now is limited to observations from 1999-2010 and in grades 3-8. 
Recall that sample sizes are reported separately for this group in the right-panel of Table 1, and rates of 
switching in lower panel of Table 2. 

As previously stated above, establishing a causal link between switching and student 


achievement is difficult since students, teachers, and schools do not randomly experience 


® We explored the possibility of using a quadratic function for years of experience but found that the acceleration 
parameter was estimated to be 0 and thus it was removed for parsimony. 
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reassignments. Many confounding factors may be associated with switching behavior and student 
achievement. 

For these reasons, we take a number of different approaches to estimating the association 
between student achievement outcomes and teacher switching behaviors, in an effort to eliminate 
potential unobserved confounding factors. We begin with a basic education production function, in 
which all observable characteristics of students, classrooms, teachers, and schools are directly 
controlled. 


Aipgsy = Po + Pi (N ewTchyy ) + B2(NewToDistpy) + B3(NewToSchyy) + By (N ewToAssignpy) 


A ingsyh + X ings(y)B3 + CygsyBa + Ty) Bs a SsyBe + Eipgsy (3) 


In Equation (3), Ajngsy is student i’s standardized test score when exposed to teacher p in grade 
gin school sin year y. Aypney is the student’s set of standardized test score in the other subject, as well 
as both subjects previous year. Xingscy) is a vector of student time-invariant and time-varying 
covariates, including gender, race/ ethnicity, free/reduced price lunch status, English language learner 
status, special education status, an indicator of whether the student’s home language is English, number 
of prior-year absences, and number of prior-year suspensions. C),4,, is a set of classroom covariates, 
which are aggregated from the student level. T,y) is the set of time-invariant and time-varying teacher 
covariates, including years of experience, sex, race/ethnicity, pathway into teaching, competitiveness of 
undergraduate institution, and math and verbal SAT scores. Finally, S;,, represents aggregated time- 
varying school-level covariates including the percentage of students who are FRPL-eligible, the school 
suspension rate, and percentage of students who are non-white. 

The main predictors of interest are a set of four key dummy variables, which indicate the kind of 


teaching assignment switch a teacher experienced in a given year, if any. The first, NewTchrp is set to 


y’ 


1 if teacher p is new to the teaching profession in year y. The second predictor, NewToDistyy, is set 
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equal to 1 if teacher p is new to New York City—but not to the profession—in year y. The dummy 
NewToSchyy equals 1 if teacher p switched to school s in year y from a different New York City school, 
and 0 if not. The last predictor, NewToAssigny,, equals 1 if the teacher switched assignments within 
the same school from last year to the current year. If all four of these variables equal 0 for a given 
teacher, the teacher experienced no change in assignment from last year to the current year. That is, he 
or she is not new to the profession, the district, the school or the subject/grade assignment in year y. 

Though we have controlled for many factors that might confound the estimated impact of 
switching, we remain concerned that other unobserved factors may be associated with both switching 
behaviors and student achievement. We therefore also introduce a number of fixed effects to further 
isolate the switching behavior. For instance, in one specification we replace the teacher time-invariant 
characteristics with teacher fixed effects so that the coefficients on the switching predictors of interest 
become within-teacher estimates. That is, we examine whether student achievement scores appear to 
be lower for the same teacher in the years that she experiences a given switch, as compared to that 
same teacher in another year in which a switch did not occur. One might be concerned, for instance, 
that less effective teachers are more likely to be churned within-school. The teacher fixed effects allow 
us to try to separate a teacher’s latent (time-invariant) effectiveness from the act of switching. This is 
one of the preferred specifications, since we will see some evidence that assignment to particular 
positions within a school might be related to teacher characteristics. However, it is of course possible 
that some teacher-level confounders—such as teaching effectiveness—depends on circumstances that 
fluctuate from year-to-year and therefore would not be captured by the teacher fixed effects. 

We also run the model with student, school, school-by-grade, and school-by-year fixed effects. 
Each of these has its own logic, isolating a source of variation that can be exploited in order to rule out a 
certain set of unobserved potential confounders. The student fixed effects, for instance, can eliminate 


any unobserved time-invariant student characteristics as a potential confounding factor for the analysis 
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by examining how a given student performs in years in which his or her teacher experienced a switch 
versus years in which the student had a teacher who did not switch. This is a useful approach if we find 
that students are non-randomly sorted to switching teachers, particularly if that sorting occurs among 
students within the same school. The student fixed effects approach remains vulnerable to unobserved, 
endogenous, time-varying factors. 

The school fixed effects approach, on the other hand, makes comparisons among switching 
teachers within the same school. This is also a potentially compelling specification because teachers 
working within the same school are generally exposed to the same leadership, building-level assignment 
policies, student composition, etc. However the school fixed-effects do not account for time-varying 
characteristics of the school, nor any important within-school variation, for example across grades. We 
therefore also run school-by-grade and school-by-year fixed effects specifications, which further limit 
the within-school comparisons to particular grades, or particular years (to rule out, for instance, the 


possibility that some secular trends in the teacher labor market may confound the analysis). 


V. Results 


RQ 1: How Often Do Teachers Switch School-, Subject, and Grade-Level 
Assignments? 


The movement of teachers to new teaching assignments is substantial (Table 2). Furthermore, 
the magnitude of the phenomenon is relatively consistent between the full 1974-2010 sample (upper 
panel of Table 2) and the restricted sample of teacher-year observations tied to student achievement in 
1999- 2010 (lower panel of Table 2). On average, 41.5 percent of teachers are switching in some way— 
either new to the profession, district, school, or their subject-grade assignment—each year (among the 
1974-2010 sample). Of those switches, there are four mutually-exclusive types of switches: (1) 15.4 
percent are new teachers, (2) 6.2 percent are new to NYC but not teaching, (3) 24.9 percent are cross- 


school movers, and (4) the clear majority of switches (53.5 percent) take place within the same school. 
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Thus, about a quarter of all teachers churn every year within their school into new subject-grade 
assignments. We can further break down the fourth group, within-school churns, into three subtypes: 
within-school subject switch only, grade switch only, or both. Here we find that most switches are across 
grade levels (68.3 percent), with the remaining 13.0 and 18.7 percent subject-only switches and both- 
grade-and-subject switches, respectively. 

Switching of any kind is less frequent in elementary schools (36.2 percent), and somewhat more 
frequent in high schools (46.9 percent) than in middle schools (44.4 percent). Within-school churning is 
particularly prevalent in high schools, with 59.6 percent of all switches occurring within-school. While 
the within-school churn rate has fluctuated modestly over time, varying between 43 and 63 percent 
over the 36 years in the analytic sample (not shown, available upon request), it has always been the 
most dominant form of switching. Overall, within-school churn is approximately twice as likely as cross- 
school reassignments each year, yet to date very little attention has been paid to its frequency or 
impact. 

In the lower panel of Table 2, we examine whether overall switching patterns are similar 
amongst the subset of teacher-years for whom we can conduct the achievement analyses for research 
question 3. By definition, the achievement analyses is limited to 1999-2010 and teachers linked to 
students (grades three through eight). Overall, patterns are quite similar, with a few notable exceptions: 
There appears to be a higher rate of new-to-profession teachers in the more recent achievement 
subsample (22.6 percent), and a corresponding lower rate of cross-school switches (16.0 percent). 
However the overall within-school churn rate is quite similar (55.5 percent of all switches are within- 
school). There are some differences in the kinds of within-school switches that are most common by 
elementary versus middle school as well; Subject-switches are more common in middle schools than in 
elementary schools, as one would expect. However subject-only and grade-only switches do occur in 


both elementary and middle school settings. 
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In describing the overall phenomenon of within-school churn, one natural question is whether 
this re-shuffling occurs simply as a result of teachers departing from the school the previous year. 
Indeed, the correlation between the rate of teacher exits from a school and the subsequent year’s 
within-school churn is 0.45, which suggests that prior year departures tend to lead to current year 
teacher switches. That said, shuffling cannot be purely accounted for by new vacancies: For every 
teacher exit from a school last year, there are on average 4.3 teachers who switch assignments within 
school the following year (Figure 1). Therefore replacing departing teachers is not a matter of simply 
moving or hiring one other teacher. Although most of the school-year observations are clustered near 
the median of 3.38 switches per exit, the spread in Figure 1 illustrates that some schools experience 
much greater switching than others. This provides some preliminary evidence that schools may engage 
in teacher reassignments differently from one another. 

Most teachers who remain in the system for multiple years will experience a switch. To report 
on the differential frequencies of switching, we examine the first fifteen years of teachers’ careers to 
explore if they are switched, and if so how often. InTable 3, when we examine teachers during their first 
two years (row 1), about 76 percent have not yet experienced a within-school switch from year 1 to year 
2, though about 24 percent do. In the second row, which examines teachers throughout the first four 
years of experience, we see that the number of teachers who have not yet churned within school drops 
to about 46.7 percent. So already by the fourth year of the career, teachers are more likely to have 
experienced a within-school churn than not. As teachers continue their career, they become even more 
likely to experience at least one (if not more) within school churns. Indeed, among teachers who are 
observed throughout the first fifteen years, only 10.6 percent have never been churned within their 
school, while 53.8 percent of those teachers will have already experienced 3 or more churns. This 
suggests that, while there may be a small group of teachers who do not experience churn, most 


experience churn early in their career and more than one time. 
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RQ 2: Are Students Who Belong to Historically Underserved Groups More Likely to 
be Assigned to Switching Teachers? 


Student-Level Analysis 


Overall, there is some modest evidence that non-white, low socioeconomic status, and ELL 
students may be more likely to be assigned to switching teachers, in some cases even within the same 
school. In Table 4, we present results across eight models (each of the four switch types, both with and 
without school fixed effects). The constant in the model represents the probability of being assigned to a 
teacher experiencing the given switch type for a male, white student who is not Free/Reduced-Price 
lunch eligible, who is not ELL and does speak English at home, with no prior-year absences and 
suspensions and with average prior achievement (in other words, a relatively advantaged student). In 
column 1 for instance, we see that such a student has an 18 percent chance of being assigned to a 
teacher who is experiencing a within-school churn. The coefficients on each student characteristic 
represent a difference in probability of being assigned to a re-assigned teacher in a given year relative to 
that more advantaged peer. The statistical significance levels are somewhat difficult to interpret given 
the very large sample sizes of students, therefore for dummy predictors we focus on coefficients that 
represent at least a one percentage point difference in probability. Black students and Hispanic students 
are both about 3 points more likely to be assigned to a within-school churned teacher (column 1), and 
ELL-designated students are 5.4 percentage points more likely to be assigned to such a teacher. The 
magnitude of these coefficients is large relative to the constant, roughly a 20 percent increase for Black 
and Hispanic students and a 30 percent increase for ELL students. In column 2, we add the school fixed 
effects and generally find that most of the associations are no longer meaningfully large (i.e., smaller 
than a 1 percentage point change). The one exception to this pattern is that the ELL finding persists 
within schools (4.6 percentage points). It is possible this reflects the difficulty of recruiting and retaining 
ELL teachers, so ELL students may be more subject to staff instability than other students even within 


the same school. 
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Transfers between schools are less frequent than within-school switching and appear to have 
little association with student attributes (columns 3 and 4 of Table 4). Black and Hispanic students 
continue to exhibit a 1 to 3 percentage point higher probability of being assigned to a teacher who is 
new to the school, but those associations are not present once we add school fixed effects in column 4. 
Unlike in columns 1 and 2, the coefficients on the ELL predictor in columns 3 and 4 are not meaningfully 
large. Overall, there seem to be fewer differences across student demographicss—both within and 
between schools—in terms of probability of being assigned to a new-to-school teacher than we saw for 
probability of being assigned to a churning teacher. However, there may also be a small, negative 
correlation between student prior achievement and probability of being assigned to a new-to-school 
teacher. 

In columns 5 and 6, we examine predictors of assignment to a “new-to-district” teacher, but we 
find that this is both a relatively infrequent event and that there are few meaningful predictors of being 
assigned to such a teacher. Finally, in columns 7 and 8, we see that Black and Hispanic students have 
about a 3 percent higher probability of being exposed to brand new teachers, relative to an estimated 
constant of 7.1 percentage points (column 7, Table 4). A few other characteristics play a role here as 
well; students eligible for free lunch have a 1.6 percentage point higher chance of encountering a new 
teacher, while an increase in student achievement of one standard deviation reduces the likelihood of 
having a new teacher by 2.2 percentage points. In addition, the coefficient on students’ ELL designation 
in the new teacher model (f= -0.021 in column 7) goes in the opposite direction from the within-school 
churn model (column 1), suggesting that ELL students are slightly less likely to be exposed to new 
teachers. 

Once school fixed effects are added (column 8) most of the differences observed in column 8 


are quite small. The coefficients on ELL (f= -0.023) and prior year test scores (S= -0.019) persist within 
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schools, suggesting that ELL students and students with lower test scores are less likely to have a new 
teacher when compared to similar students within the same school. 

Taken together, these results suggest that historically underserved students may have 
somewhat higher probabilities of being assigned to within-school switching teachers, even when 
controlling for all other observed covariates and, in some cases, even when limiting comparisons to 
students in the same school. However, the magnitude of these differences is typically small. The largest 
estimated coefficient is about a 5 percentage point difference. These multivariate models set the stage 


for the fixed effects models employed to estimate the impact of switching on student achievement.’ 


Teacher-Level Analysis. 


The analysis above suggests why it is important to account for observable student 
characteristics that may be both associated with assignments to teachers who churn, as well as student 
achievement. In the same vein, we explore whether female and minority teachers with different 
pathways into the profession, less experience, or lower value-added scores may be more likely to churn 
(or be churned). 

In Table 5, we present results from three versions of Equation (2), in which we predict 
probability of experiencing a within-school churn (“NewToAssigny,,”) as a function of the full set of 
teacher covariates described above (column 1). In column 2, we replace the time-invariant teacher 


characteristics with teacher fixed effects. In column 3, we add school fixed effects so that we can make 


TTn results not shown for the sake of parsimony (but available upon request), we also estimate simple univariate 
relationships between individual student covariates and assignment to churning, new-to-school, new-to-district, and 
brand new teachers. By examining student predictors one at a time, we can address the question of whether any 
negative estimated impacts are likely to be disproportionately experienced by students of color, of low 
socioeconomic status, or for students who are English language learners. (Sets of categorical dummy variables are of 
course still kept together in a single model—for instance, when exploring student race/ethnicity, the indicators for 
Black, Hispanic, Asian, and Other/Unknown are all included so that the reference category is White students.) As 
one would expect, many more of the simple linear relationships are statistically significant than in Table 4 (though 
most remain substantively small). However it is clear that—if being new-to-assignment, the school, the district, or 
teaching negatively impacts achievement overall— then Black, Hispanic, Free/Reduced-Price Lunch eligible, non- 
native English speakers with lower prior achievement would be more likely to be assigned to those teachers. Even 
though the associations are modest, having more than one risk factor could aggregate, perhaps leading to an equity 
issue related to exposure to teachers who are new to their subject, grade, and or school assignment. 
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comparisons among teachers within the same school. Again, the school fixed effects are crucial for 
allowing us to disentangle sorting of teachers across schools that may assign teachers differently from 
non-random assignment of teachers within schools. 

We are also interested in whether a teacher’s probability to be churned was related to his or her 
value-added scores in the year preceding the observation, however only approximately 15 percent of 
the sample possesses these value-added scores. In columns 4 through 6, we added prior-year value- 
added scores (PriorVA,y)® to each model, though aware this dramatically alters the analytic sample. This 
allows us to explore, for instance, whether the same teacher tends to be re-assigned in relation to 
fluctuations in her value-added estimates of effectiveness over time. However because fluctuations 
from year-to-year in value-added are noisy within person, this model may not capture the meaningful 
changes in true teaching effectiveness which could predict propensity to be switched to a new 
assignment. 

Controlling for other factors, there are some systematic differences in teachers’ propensities to 
be switched to a new assignment in their same school, however the magnitude of these differences is 
typically not large. For instance, we see in column 1 that, while the conditional probability of a within- 
school switch is statistically different for male and female teachers, the difference is about half a 
percentage point (B= -0.006**). Again, for dummy predictors we choose to focus on relationships that 
are least one percentage point different in magnitude. When not including school fixed effects, Black 
and Hispanic teachers are 2 to 2.7 percentage points more likely to experience a within-school switch, 
and while the magnitude diminishes when we include school fixed effects (column 2), they do not 
disappear. In terms of teacher preparation, SAT are not a strong predictor, but we do see some 1-point 
differential probabilities by competitiveness of undergraduate institution (which persist in column 3 


when school fixed effects are included). There are also some differences in conditional propensity to 


8 See Appendix B for a full explanation of how value-added scores are estimated. 
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switch by teacher pathway: TFA teachers are 3.7 percentage points less likely to be switched than 
teachers entering the profession through traditional pathways (omitted category), while those entering 
through other (e.g, alternative certification) or unknown pathways are slightly more likely to be 
switched within school. Again, the findings on teacher pathway variables persist in the school fixed 
effects model, but are somewhat more muted. Finally, we see that there is a statistically significant but 
substantively weak, negative relationship between experience and switching (f= -0.001** in column 1), 
which suggests that, conditional on all other observed covariates, more veteran teachers are slightly less 
likely to be re-assigned than similar teachers with fewer years of experience (results are similar when we 
include school fixed effects in column 3). It is interesting to note, however, that when we replace the 
time-invariant teacher covariates with the teacher fixed effects in column 2, the coefficient on years of 
experience reverses direction, though it remains substantively small (G= 0.004*** in column 2). 

Finally, we repeat these three models by adding teacher prior value-added (see Table 5, 
columns 4-6). Recall that these models are now necessarily restricted to grade 4 — 8 math and ELA 
teachers, by virtue of including value-added scores. Prior value-added scores are a significant predictor 
of propensity to churn: The higher one’s value-added, the less likely they are to churn (G= -0.072*** in 
column 4), even when comparing teachers in the same school (G= -0.070*** in column 6). It is 
interesting to note, however, that when we examine the results from the model that predicts outcomes 
by prior value-added scores with teacher fixed effects included in the model, no relationship persists. In 
other words, value-added scores do not appear to predict why the same teacher is assigned to switch 
assignments within school in some years but not others. 

Taken together, these results suggests that teachers may be systematically targeted for re- 
assignment both within- and between- schools. Teacher race/ethnicity is a persistent predictor of 
propensity to be reassigned in all models. The relationship between years of experience and 


reassignment depends on whether looking within or across teachers, and whether one also controls for 
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prior value-added. Prior value-added is also related to propensity to be reassigned, except when looking 
within teacher. The covariates in Table 5 will be included as controls in the subsequent models used to 
isolate exogenous variation in reassignments, so we do not have to be concerned specifically about 
these factors biasing our estimates. However, we are concerned that, if teachers are systematically 
reassigned based on the things we do observe, there may be other teacher-level endogenous variables 
that we do not observe that cannot be included directly. For this reason, teacher fixed effects may prove 
a particularly important specification of models used to link reassignment to impacts on student 


achievement. 


School-Level Analysis. 


We find some evidence that schools that serve higher percentages of Black students, English 
Language Learners, or students with higher rates of suspension or absenteeism also tend to exhibit 
more within-school churn (see Table 6). For instance, a one percentage point increase in the number of 
Black students in the school is associated with a 0.037 percentage point increase in the churn rate 
(statistically, but likely not substantively significant). It does appear that, conditional on other school 
factors, schools with high rates of absenteeism and suspensions exhibit great within-school switch rates. 

Overall, there is some evidence that historically underserved groups of students are more likely 
to be assigned to switching teachers (even within the same school), certain kinds of teachers are more 
likely to be switched, and certain schools may experience greater degrees of switching, however these 
relationships tend to be weak. These findings have two potential implications. The first is that it may be 
difficult to isolate the impact of churning from the fact that this behavior appears to be non-random— 
an issue we take up in the next section. The second implication is that, if we do find evidence of negative 
impacts of these various forms of being new to one’s assignment, some students may be more likely to 


experience those negative effects. 
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RQ 3: What is the Impact on Students of Being Assigned to Switching Teachers? 


Switching teacher assignments negatively affects student achievement across all four types of 
switches. Table 7 presents results for student achievement outcomes in Math (top panel) and ELA 
(bottom panel). Given that the conceptual model suggests that “newness” and “unfamiliarity” might be 
the primary mechanism driving a negative impact of switching, the relative magnitude of the results 
seems reasonable: Brand new teachers are new to all aspects of their assignments— the job itself, the 
school, the colleagues, as well as the specific class itself. Therefore we are not surprised that 
achievement is lowest when assigned to a brand new teacher. Teachers who are moving across districts 
or schools, on the other hand, are confronting new circumstances and social norms, but they are not 
new to the act of teaching and thus we would expect the negative impact of this form of “newness” 
would be relatively less strong than being completely new. Finally, teachers who churn within the same 
school are not new to the school culture, but their particular subject-grade assignment, responsibilities, 
and immediate subject- or grade-level assignments have changed. The results suggest that the more 
aspects of one’s subject-grade-school assignment are unfamiliar, the more negative the impact of the 
reassignment. Results are relatively consistent across all model specifications with various fixed effects 
in math. For instance, the coefficient on the indicator for within-school churn is consistently between - 
0.010 and -0.018 and statistically significant in all models. Though the magnitude of these effects is small 
(on average, about a quarter of the size of the effect of having a new teacher), keep in mind that nearly 
four times more teachers are new-to-assignment than new to the profession each year. Indeed about a 
quarter of a// teachers are reassigned within school each year, thus making the aggregate effect on the 
distribution of student achievement notable. The estimates are closest to zero in the model that 
includes teacher fixed effects, and largest in the model that includes school fixed effects. Results are also 


negative for ELA outcomes (lower panel of Table 7), however the coefficients on the within-school churn 
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variable are closer to -0.004 to -0.11 (and not statistically significant in the model with teacher fixed 
effects). 

Recall that, about 20 percent of the person-years in the dataset do not have a clear “primary” 
subject-grade level assignment. We conduct a bounding exercise related to these ambiguous teacher- 
year observations and find that our results are robust to the various assumptions one could make about 
the status of those unknown cases (see Appendix C for descriptive of approach and presentation of 


results). 


Is it Harder to Switch Subjects, Grades, or Both? 


In order to further probe the nature of the negative impact of within-school churning, we 
hypothesized that switches might be more challenging for teachers when they were more dissimilar to 
the prior year assignment. For instance, it might be the case that it is more difficult to switch both 
subjects and grades simultaneously rather than just switching one or the other. To explore this, we 
further subdivided the within-school churn indicator into three distinct sub-categories (a) a within- 
school switch of subject only (grade remained the same), (b) a within-school switch of grade only 
(subject remained the same), and (c) a within-school switch of both subject and grade. In essence, we 
ran Equation (3) with six dummy variable predictors of interest rather than four, in which the indictor of 
within-school churn “NewT oAssign,,,” has now been replaced by the three sub-categories of churn- 
type described above. 

Of the within-school switches, 71 percent were a grade switch only, 14 percent were a subject 
switch only, and 15 percent were both (refer back to Table 1). While it is straightforward to think about 
scenarios in which teachers switch grades only, it may be less clear what kinds of transitions are 
captured by the “subject-only” switch category—that is, teachers remaining in the same grade and 
school but teaching a different subject. Indeed, this is the least common form of within-school switch. 


Many of the subject-only switches are characterized by teachers who were assigned to a grade-specific 
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“English as a Second Language” classroom, or a “Special Education” classroom in the previous year but 
now are in ELA, math, or elementary (i.e., whole classroom) positions in the current year. We also see 
teachers who were previously teaching a non-tested subject to a specific grade (e.g., fine arts, science, 
foreign language, or social studies) who now primarily teach math, ELA, or elementary students in the 
current year. One might be concerned that subject-only switches only occur in some grades, thus 
limiting those analyses to specific grade levels. However subject-only switchers are approximately 
evenly distributed across grades, with the exception of grade 6, which has about twice as many subject- 
only switchers as any other grade. 

Switching both subjects and grades at the same time is more difficult than just switching one or 
the other. Table 8 presents the results for this analysis for math achievement outcomes for just three 
specifications of the model—with teacher (M2), school (M3), or student fixed effects (M6)—for the sake 
of parsimony. According to the model with student fixed effects (final column), switching both subject 
and grade is associated with a -0.023 decrease in student achievement, while switching subjects only 
was associated with a -0.010 decrease, and switching grades only was associated with a -0.019 decrease. 
Results for Model 2 (teacher fixed effects) and Model 3 (school fixed effects) also show that switching 
both subject and grade may be slightly more negative than switching only one or the other, though the 
magnitude of all coefficients is again smallest in the teacher fixed effect specification. Taken together, 
these findings suggest that the phenomenon may operate in a way that is consistent with a conceptual 
frame of newness—when both subject and grade level are new, the challenge of teaching may be 


greater when either the approximate age or the subject matter has not changed. 


Is the Impact of Switching Temporary? 


When thinking further about our descriptive findings that teachers appear to be reassigned 
within their school multiple times during their career, we wondered about whether the impact of 


switches might be temporary—i.e., strongest in the year in which the teacher was new to the school, 
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subject, and/or grade. We imagine three possible scenarios for what we might observe. First, it is 
possible that switching teachers may have a temporary cost in terms of teacher impacts on student 
achievement in the year of the switch, but ultimately these switches might lead teachers to find a better 
fit between their own strengths and their teaching assignment. In this scenario, we would expect to find 
that student achievement scores drop in the year of the switch itself, however in subsequent years the 
teacher’s students’ scores would exceed pre-switch levels. A second possibility is that switches are less 
strategic and more random. In this case, we would expect to find that scores drop in the year of the 
switch, but in post-switch years teachers simply revert back to their pre-achievement switch levels. In 
other words, there is nothing about the switch experience that systematically improves the teacher’s 
ability to improve student learning. The third possibility is that switching is a negative experience with 
lasting negative impacts on teachers. If this were the case, we would expect to find that, after student 
test scores drop in the year of a switch, they do not return to pre-switch levels afterwards. 

In order to examine these competing hypotheses about the lasting impacts of switching 
behavior, we use the education production function framework from Equation (3) but change the coding 
scheme to reflect whether each student was assigned to a teacher who switched (a) in the current year, 
(b) last year, (c) two years ago, or (d) three or more years ago. The omitted category then becomes 
expected achievement outcomes for students in years that pre-date the first reassignment. 
Furthermore, we limit the sample here to the set of teacher-year observations that occur one year prior 
to a teacher’s first within-school switch and one year before a second switch occurs. Because teachers 
switch many times in their career on average, mid-career years can ambiguously be classified as either 
post- one switch, but simultaneously pre- the next switch. Imagine, for instance, that a teacher is re- 
assigned within the school in both her third and fifth years on the job. The fourth year could be 
considered the year after the first switch, but also the year before the next switch. Limiting the sample 


in this way allows us to isolate a subset of teacher-year observations in which the temporal pattern of 


30 


switching is unambiguous, however it also narrows the focus to the effects of the first time a teacher is 
switched. 

Results in Table 9 differ somewhat depending on model specification. As before, we see that 
there is a negative decrement to student achievement in the year a teacher is re-assigned. However, the 
coefficients on years subsequent to the switch are less consistent across models. While the coefficients 
tend to be positive, suggesting that the teachers’ students are performing better than they had in the 
year before the switch occurred, those differences are significant only in the models with school-by- 
grade, school-by-year, and student fixed effects. In this temporal exploration, the specification with 
teacher fixed effects is perhaps most straightforward in terms of thinking about a teacher’s pattern of 
switch behavior from one year to the next. In that version of the model (column 2), there do not appear 
to be any statistically significant differences between pre-switch and post-switch student outcomes. The 
lack of positive increases post-switch suggests that—however decisions are made about shuffling 
teachers within the same school—these movements do not appear to match teachers to subject-grade 


assignments in which they are more effective. 


VI. Conclusions 


This paper documents a phenomenon that most practitioners understand but that education 
researchers have largely ignored: The incredible prevalence of annual within-school reassignments to 
new teaching positions. We have situated this phenomenon within a larger body of work that examines 
other instances in a teacher’s career when he or she is new to their teaching assignment—either in the 
first year on the job, new to the district, or when teachers move across schools from one year to the 
next. All of these switch types share a common theme—it is more difficult to be effective at complex 
tasks when the task or context is unfamiliar. We contribute to this body of work by documenting that 


within-school switches in New York City are twice as common as between-school switches, and nearly 
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four times more likely as being new to the profession. We also find that there is a modest negative 
impact of being assigned to teachers when they are new to teaching, the district, the school, or their 
subject-grade assignment. The relative negative impact of these phenomena follows a pattern that 
suggests that the more “new” the teaching assignment is, the more challenging the teaching may be ina 
given year: The impact on student achievement is most negative when students are assigned to brand 
new teachers, followed by teachers who are new to the district or school, and finally (least strongly but 
still negative) to teachers who are in the same school but new to their subject and/or grade. 

The estimated impact of within-school churn is not large in absolute terms. However, given that 
about a quarter of all teachers each year are churning within the same school, these small negative 
decrements add up: The estimated impact of churning is, on average, about a quarter of the size of the 
impact of being assigned to a brand new teacher—a phenomenon that has received a great deal of 
attention in the field. However, in any given year, more nearly four times as many students will be 
assigned to a churning teacher than a new teacher, in essence quadrupling the overall impact on the 
distribution of student achievement. Stated another way, the average student only encounters one 
brand new teacher between grades three through eight, but four or five churning teachers in the same 
time frame. Furthermore, we find some evidence that some schools experience more of this churn than 
others, and one might be concerned that schools serving disadvantaged populations of students are also 
the schools most likely to have instability in their teacher assignments. Our analysis also suggests that 
even within the same schools, historically-underserved student groups may be more likely to be 
assigned to churning teachers than their more privileged counterparts: While the average student has 
about a 24 percent chance of being assigned to a churning teacher in any given year, a white, male 
student who is not FRL-eligible, is not an ELL student, and has not been suspended only has an 18 


percent chance of being assigned to a churning teacher. Taken together, the results of the current paper 
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suggest a widespread and understudied phenomenon that negatively affects the students of almost all 
teachers at some point in their career, and disproportionally affects disadvantaged students. 

It is important to acknowledge that this paper focuses on a particular context: New York City. It 
is not necessarily the case that findings regarding the frequency or impact of switching would be similar 
in smaller or less urban districts. While we do not have access to achievement outcome data outside of 
New York City, we do possess information about the teaching assignments of teachers across the entire 
state since 1974. We therefore calculate the average within-school switch rate for each district in New 
York state that serves, on average, at least 10,000 students per year. In 
Figure 2, we present the distribution of those within-school switch rates across districts in order to see 
whether New York City appears to have an unusually high rate. One can see that New York City’s 
reported within-school switch rate (about 22 percent per year) is toward the high end, however the 
average within-school switch rate is 15 percent, and 16 percent of New York State districts appear to 
have a higher average within-school rate than New York City. We hypothesized that teacher movements 
might be less frequent in smaller districts and rural districts. In Table 10, we therefore also present the 
average district-level rates of new-to-profession, new-to-district, new-to-school, and new-to-assignment 
(i.e. within-school) switches for other New York state districts of different sizes and different geographic 
types (city, suburban, town, and rural). For reference, the New York City rates are reported at the 
bottom of Table 10. 

Indeed, it is the case that fewer switches occur in rural districts than in New York City. However 
it appears that switch rates in other non-NYC districts that are large and urban exhibit are nearly as high 
as in NYC. Our findings may therefore generalize more to these kinds of environments, rather than 
smaller districts in towns or rural areas. However in most kinds of districts shown in Table 10, between 
30 and 40 percent of all teachers experience some kind of switch every year. This suggests that these 


movements affect districts of all size, though perhaps to a lesser degree than in NYC. A brand new paper 
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that examines the frequency specifically of grade-switching (both within and across schools) in a large 
California district was recently published (Blazar, 2015).9 Findings from that paper with regard to the 
surprising frequency of assignment switching (in their case, particularly grade-switching). This suggests 
that assignment instability is a prevalent phenomenon outside the New York setting. 

This paper generates several questions. While we conclude that the average impact of within- 
school churn appears to be negative, it is not clear whether that average effect is a relatively accurate 
description of the effect in all places, or instead whether the impact varies dramatically perhaps from 
one school to the next. We hypothesized that some teacher reassignment could be beneficial for 
students if these decisions are made strategically in order to optimize what and where teachers teacher. 
However in the current data we have no way to differentiate discretionary movements intended to 
either improve student outcomes (e.g., | think teacher A will work more effectively with older students) 
or to satisfy teacher requests for certain types of students or subject matter from unavoidable staffing 
driven movements (e.g., the need to replace exiting teachers or there are more fourth graders this year 
than last year and so we need to move some teacher into fourth grade). One might hypothesize that 
some school leaders may develop strategies around re-allocating teachers that benefit students. Again, 
this is difficult to observe in the current data, as we have relatively shallow insight into how individual 
schools are managed. In results not shown here, we conducted preliminary analyses to explore whether 
the impact of churn was different for schools in the top and bottom third of distributions on various 
student characteristics (i.e., schools in the top third of math performance vs. the bottom third). In none 
of these top- versus bottom-third comparisons were the impacts of churn positive, nor were the group 
differences statistically significant from one another. The lack of differential impact across these groups 


is only a first step towards trying to identify places where within-school reassignments are conducted in 


° The current paper was first presented at the Association for Public Policy Analysis and Management (APPAM) 
Conference in November 2013. Since our initial submission to this EEPA, the Blazar (2015) paper was published in 
Educational Researcher. 
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strategic ways that benefit students. Administrative data alone provides relatively blunt ways of 
characterizing schools, and these demographic dimensions may fail to help us account for any variability 
in the effect of churn across schools. Future work in this area might generate and test hypotheses for 
school characteristics that could cause or support beneficial within-school churn. 

We end with a final word on the policy implications of the current analyses. Of course, it is 
impractical to imagine that within-school churn can or should be eliminated by policy. Indeed, it is an 
unavoidable artifact of such a large system that instability can and will occur. The current findings do 
highlight just how much of that switching is taking place on an annual basis: a full 40 percent of all 
teachers are new to the district, the school, or their subject-grade each year, and half of those switches 
occur within school. If our findings are corroborated in other districts, it may be the case that school 
administrators should recognize that re-assigning a teacher will have a small, negative impact on 
students, and that exposing students to high doses of this churning could more meaningfully influence 
their achievement. This recognition may cause schools and districts to temper the level of discretionary 
churning. Future research could collect more nuanced data to classify different types of churning and 


better understand whether discretionary churning benefits students. 
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Tables 


Table 1. Sample Size Comparisons based on Missing Teacher Switching Data 


Teachers Linked to Student Achievement 
All Teachers 1974 - 2010 
ania (1999-2010, Grades 3-8) 


Unique Teacher- Year Unique Teacher- Year 
Teachers Observations Teachers Observations 
Number (%) Number (%) Number (%) Number (%) 


All Teachers in Traditional 
Public Schools (not in Ist 
Year School Opened) 271,492 (100.0) 2,402,983 (100.0) 179,037 (100.0) 1,013,664 (100.0) 


Omit Observations 
Due to Problem 
with 2003 File 270,149 (99.5) 2,327,540 (96.9) 177,484 (99.1) 938,221 (92.6) 


Omit Observations 
Missing Subject, 
Grade, or Both 269,711 (99.3) 2,254,330 (93.8) 177,123 (98.9) 897,509 (88.5) 


Omit Observations 
Where Primary 
Assignment Unclear 268,080 (98.7) 1,953,451 (81.3) 175,418 (98.0) 785,076 (77.4) 
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Table 2. Frequency of Switching Overall, by Type of Switch, and by Type of Within-School Switch 


All Teacher-Years 1974 - 2010 


Breakdown Only Among Breakdown Only Among 
All Teacher- Years All Types of Switches Within-School Churns 
Tv VWithine ~ Subject. Grade Switch 
Any_ New to New to New to School Switch_ Switch Both Sub 
No Switch Switch Profession NYC School Churns Only Only & Grade 
Overall Rates 
AllTeachers 58.5% 41.5% 15.4% 62% 249% 53.5% 13.0% 68.3% 18.7% 
By School Type 
Elem. 63.8% 36.2% 17.2% = 7.7% 23.5% 51.7% 15.8% 68.7% 15.5% 
Middle 55.6% 44.4% 16.3% 60% 243% 53.5% 144% 65.1% 20.5% 
High 53.1% 46.9% 12.5% 47% 23.3% 59.6% 10.3% 67.8% 21.9% 


Teacher-Years Tied to Student Achievement Outcomes (Grades 3-8, 1999 - 2010) 


Breakdown Among Breakdown Among 
All Teacher- Years All Types of Switches Within-School Churns 
Within- Subject Grade = Switch 
Any. Newto Newto Newto School Switch = Switch ~— Both Sub_ 
No Switch Switch Profession NYC School Chums Only Only & Grade 
Overall Rates 
AllTeachers 57.8% 42.2% 22.6% 6.0% 16.0% 55.5% 13.8% 714% 148% 
By School Type 
Elem. 61.4% 38.6% 21.3% 7.1% 13.7% 58.0% 12.6% 765% 10.9% 
Middle 52.2% 47.8% 23.7% S4% 17.9% 53.0% 18.1% 62.9% 19.0% 
High n/a na n/a n/a na n/a n/a n/a n/a 
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Table 3. Percent of Teachers Who Experience 0, 1, 2, or 3+ Within-School Churns, 


Within Given Periods of their Career 
No Switches 1 Switch 2 Switches 3+ Switches 


First 2 Years 76.0% 24.0% n/a n/a 
First 4 Years 46.7% 29.4% 13.4% 10.5% 
First 6 Years 34.0% 29.2% 18.3% 18.5% 
First 8 Years 25.7% 26.6% 20.2% 27.5% 
First 10 Years 19.4% 23.8% 20.8% 36.0% 
First 15 Years 10.6% 17.3% 18.3% 53.8% 


Each row is limited to the set of teachers who are observed at least in 
their first X years of teaching, and the columns capture the number of 
switches (0, 1, 2, or 3+) that have occurred within those first X years. 


Al 


Table 4. Predicting Students’ Conditional Probability of Assignment to Switching Teachers, 
based on Full Vector of Student Characteristics 


Y= "NewToAssignpy" Y= "'NewToSch,,y" 


Y= "NewToDist,y" 


Y= "NewTch,," 


(Teacher Switches (Teacher Switches (Teacher New to NYC, (Teacher New to 
within Same School) from Other School) Not Profession) Teaching Profession) 
Female 0.002 * 0.002 **  -0.001 -0.001 ** -0.001 *  -0.001 * -0.001 * = -0.002 ** 
(0.001) (0.001) 0.000 0.000 0.000 0.000 0.000 0.000 
Black 0.031 *** -0.006 *** 0.029 *** 0.004 *** 0.004 *** 0.001 0.029 *** 0,005 *** 
(0.001) (0.001) (0.001) (0.001) 0.000 (0.001) (0.001) (0.001) 
Hispanic 0.032 *** 0.003 * 0.017 *** 0.000 -0.001 * 0.000 0.031 *** 0.000 
(0.001) (0.001) (0.001) (0.001) 0.000 (0.001) (0.001) (0.001) 
Asian -0.008 *** -0.001 -0.001 -0.002 -0.001 ** -0.001 0.001 -0.003 ** 
(0.001) (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) 
Free-Lunch Elig. 0.007 *** -0.004 *** 0.002 *** 0.003 *** -0.001 0.001 0.016 *** 0,009 *** 
(0.001) (0.001) (0.001) (0.001) 0.000 0.000 (0.001) (0.001) 
Red. Lunch Elig. 0.002 -0.003 -0.001 0.002 * -0.002 ** 0.000 0.005 *** 0.002 * 
(0.002) (0.002) (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) 
Home Lang Not 0.004 *** -0.002 ** -0.001 * 0.005 *** 0.001 0.001 *** 0.007 *** 0.007 *** 
English (0.001) (0.001) (0.001) (0.001) 0.000 0.000 (0.001) (0.001) 
Designated ELL 0.054 *** 0.046 *** 0.002 * 0.000 -0.001 -0.001 * -0.021 *** -0.023 *** 
(0.001) (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) 
Number of 0.000 0.000 *** 0.000 *** 0.000 ** 0.000 0.000 0.000 *** 0.000 *** 
Absences 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 
Number of 0.001 0.000 0.003 *** 0.000 0.000 -0.001 0.005 *** 0.001 
Suspensions (0.001) (0.001) (0.001) (0.001) 0.000 0.000 (0.001) (0.001) 
Prior Mean Std Test 0.003 *** 0.007 *** -0.013 *** -0.009 *** -0.005 *** -0.005 *** -0.022 *** -0.019 *** 
Score 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 
Constant 0.180 *** 0.215 *** 0.053 *** 0.066 *** 0.026 *** 0.025 *** 0.071 *** 0.100 *** 
(0.001) (0.001) (0.001) (0.001) 0.000 (0.001) (0.001) (0.001) 
R-squared 0.003 0.065 0.006 0.098 0.001 0.031 0.010 0.064 
N 1,496,416 1,496,414 1,496,416 1,496,414 1,496,416 1,496,414 1,496,416 1,496,414 
Grade Fixed Effects? Y Y Y Y Y Y Y Y 
School Fixed Effects? N Y N Y N Y N Y 
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Table 5. Predicting Teachers’ Probability of Within-School Reassignment, based on Teacher 


Characteristics 
All Teachers Limit to Teachers with VA Scores 
(Column): (Cl) (C2) (C3) (C4) (C5) (C6) 
Teacher Male Teacher 0.006 *** -0.006 *** 0.003 -0.002 
Demographics (0.001) (0.001) (0.004) (0.005) 
Black Teacher 0.020 *** 0.016 *** 0.032 *** 0.019 *** 
(0.001) (0.002) (0.005) (0.005) 
Hispanic Teacher 0.027 *** 0.021 *** 0.064 *** 0.056 *** 
(0.002) (0.002) (0.006) (0.006) 
Teacher Race Oth/Unk 0.003 0.008 *** 0.025 *** 0.017 * 
(0.002) (0.002) (0.007) (0.007) 
Teacher Std Math SAT -0.004 ** -0.004 ** -0.008 -0.004 
Preparation (0.001) (0.001) (0.004) (0.004) 
SAT Score Missing Dummy 0.003 * -0.005 *** 0.005 0.002 
(0.001) (0.001) (0.004) (0.004) 
Std Verb SAT 0.001 0.001 0.005 0.004 
(0.001) (0.001) (0.004) (0.004) 
UG Inst Most Competetive -0.009 *** -0.009 *** -0.011 -0.001 
(0.002) (0.002) (0.007) (0.007) 
UG Inst Competetive -0.012 *** -0.010 *** -0.009 -0.005 
(0.002) (0.002) (0.006) (0.006) 
UG Inst Less Competetive -0.011 *** -0.010 *** -0.005 -0.001 
(0.001) (0.001) (0.005) (0.005) 
UG Inst Unknown -0.013 *** -0.021 *** -0.014 * -0.015 * 
(0.002) (0.002) (0.007) (0.007) 
Teaching Fellows Pathway 0.003 0.006 0.032 ** 0.027 * 
(0.004) (0.004) (0.011) (0.011) 
TFA Pathway -0.037 *** -0.030 *** 0.070 *** 0.055 ** 
(0.007) (0.007) (0.018) (0.018) 
Other Pathway 0.015 *** 0.010 *** 0.012 ** 0.007 
(0.001) (0.001) (0.004) (0.004) 
Unknown Pathway 0.025 *** 0.015 *** 0.008 0.010 
(0.002) (0.002) (0.007) (0.007) 
Time-Varying Yrs of Experience -0.001 *** 0.004 *** = -0.001 *** -0.001 *** 0.011 *** = -0.001 *** 
Characteristics 0.000 0.000 0.000 0.000 (0.001) 0.000 
Prior Year VA Score -0.072 *** — -0.024 -0.070 *** 
(0.010) (0.014) (0.010) 
constant 0.216 *** 0.167 *** 0.224 *** 0.264 *** 0.171 *** 0.272 *** 
(0.002) (0.002) (0.002) (0.005) (0.009) (0.005) 
R-Squared 0.0020 0.3350 0.0240 0.0050 0.5090 0.0430 
N 616,608 616,608 616,608 64,788 64,788 64,788 
Fixed Effects? None Teacher School None Teacher School 


Omitted Categories include female teachers, white teachers, and teacher who attended an undergraduate institution that was 


"not" competetive and entered teaching through a traditional "college-recommended" pathway. The value-added score is the 


mean of math and ELA value-added scores (when both are available in the same year) from the year preceding the switch. 
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Table 6. Three-Year Average Within-School Churn Rate, as a Function of Average School Characteristics 


Avg. School Enrollment 


Percent Students Female 


Percent Students Black 


Percent Students Hispanic 


Percent Students Free/Red Price Lunch 


Percent Students ELL 


Avg. Number of Suspensions 


Avg. Number of Absences 


Percent Students Special Education Status 


Percent of Teachers Who Left Last Year 


Constant 


R-Squared 
N 


0.003 *** 
0.000 


0.036 
(0.020) 
0.037 *** 
(0.007) 
-0.001 
(0.008) 
-0.005 
(0.010) 
0.114 *#* 
(0.018) 
4.461 *** 
(1.276) 
0.181 *** 
(0.030) 


-0.021 
(0.021) 


13.283 *** 
(3.244) 


0.083 
3247 


Predictors are school-level 3-year means (2007-2009), expressed as 


percentage points on a scale of 0 to 100. The outcome is the 3-year mean 


churn rate in the school (2007-2009), also expressed as percentage ona 


scale of 0 to 100. 
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Table 7. The Impact of Three Switch Types on Student Math Achievement, Across Model Specifications 


New to Teaching 


Profession 


New to NYC 


(Not Profession) 


Switched from 


Other Sch 


Switched Within 


Same Sch 


R-squared 


Num Teachers 


-0.068 *** 
(0.002) 


-0.044 
(0.003) 


-0.051 *** 
(0.002) 


-0.015 *** 
(0.001) 


0.654 
21997 


-0.061 *** 
(0.002) 


-0.038 *** 
(0.004) 


-0.031 *** 
(0.002) 


-0.010 *** 
(0.001) 


0.688 
21997 


-0.071 *** 
(0.002) 


-0.042 
(0.003) 


-0.050 *** 
(0.002) 


-0.018 *** 
(0.001) 


0.657 
21997 


-0.071 *** 
(0.002) 


-0.044 
(0.003) 


-0.051 *** 
(0.002) 


-0.017 *** 
(0.001) 


0.665 
21997 


-0.075 *** 
(0.002) 


-0.046 *** 
(0.003) 


-0.053 *** 
(0.002) 


-0.017 *** 
(0.001) 


0.668 
21997 


-0.076 *** 
(0.002) 


-0.061 *** 
(0.003) 


-0.054 #*# 
(0.002) 


-0.016 *** 
(0.001) 


0.89 
21997 


Num Obs. 1550778 1550778 1550778 1550778 1550778 1550778 


Fixed Effects? -- Teacher School Sch x Grade Sch x Year Student 
M1 M2 M3 M4 M5 M6 


New to Teaching 


Profession 


New to NYC 
(Not Profession) 


Switched from 


Other Sch 


Switched Within 


Same Sch 


R-squared 


-0.041 
(0.002) 


-0.023 *** 
(0.003) 


-0.011 *** 
(0.002) 


-0.004 
(0.001) 


0.584 


-0.033 *** 
(0.002) 


-0.008 
(0.005) 


-0.007 * 
(0.003) 


0.000 
(0.002) 


0.603 


-0.041 
(0.002) 


-0.021 *** 
(0.003) 


-0.015 *** 
(0.002) 


-0.006 ** 
(0.001) 


0.586 


-0.041 
(0.002) 


-0.023 *** 
(0.003) 


-0.015 *** 
(0.002) 


-0.006 * 
(0.001) 


0.590 
22540 


-0.042 * 
(0.002) 


-0.021 *** 
(0.003) 


-0.020 *** 
(0.002) 


-0.009 *** 
(0.001) 


0.594 
22540 


-0.042 
(0.002) 


-0.026 *** 
(0.004) 


-0.019 *** 
(0.002) 


-0.011 ** 
(0.001) 


0.850 
22540 


22540 22540 


1539260 


22540 


1539260 
Teacher 


Num Teachers 
Num Obs. 1539260 1539260 1539260 1539260 
Fixed Effects? School Sch x Grade Sch x Year Student 

All models shown here have time-varing and time-invariant student characteristics, aggregated time-varying 
classroom covariates, teacher time-invariant and time-varying characteristics, and school time-invariant and time- 
varying characteristics (except when collinear with the relevant fixed effects). 
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Table 8. Effects of Different Kinds of Within-School Switches: Subject Only, Grade Only, or Both 


MATH 
M2 M3 M6 

New to Teaching Profession -0.061 *** -0.071 *** -0.076 *** 

(0.002) (0.002) (0.002) 
New to NYC -0.038 *** -0.042 *** -0.061 *** 
(Not Profession) (0.004) (0.003) (0.003) 
Switched from -0.031 *** -0.050 *** -0.054 *** 
Other Sch (0.002) (0.002) (0.002) 
(a) Switched Subject (only) 0.000 -0.004 -0.004 
Within Same Sch (0.003) (0.002) (0.003) 
(b) Switched Grade (only) -0.012 *** -0.024 *** A021 FF 
Within Same Sch (0.001) (0.001) (0.001) 
(c) Switched Grade & Subj. -0.013 *** -0.019 *** -0.015 *** 
Within Same Sch (0.004) (0.003) (0.003) 
R-squared 0.688 0.657 0.890 
Num Teachers 21,997 21,997 21,997 
Num Obs. 1,550,778 1,550,778 1,550,778 
Fixed Effects? Teacher School Student 

ELA 
M2 M3 M6 

New to Teaching Profession -0.033 *** -0.041 *** -0.042 *** 

(0.002) (0.002) (0.002) 
New to NYC -0.008 071 3" -0.026 *** 
(Not Profession) (0.005) (0.003) (0.004) 
Switched from -0.007 * -0.015 *** -0.019 *** 
Other Sch (0.003) (0.002) (0.002) 
Switched Subject (only) 0.004 0.004 -0.005 
Within Same Sch (0.003) (0.003) (0.003) 
Switched Grade (only) -0.002 -0.006 *** -0.004 * 
Within Same Sch (0.002) (0.001) (0.002) 
Switched Grade & Subj. 0.002 0.000 -0.010 ** 
Within Same Sch (0.004) (0.003) (0.003) 
R-squared 0.603 0.586 0.850 
Num Teachers 22,540 22,540 22,540 
Num Obs. 1,539,260 1,539,260 1,539,260 
Fixed Effects? Teacher School Student 
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Table 9. The Temporal Impact of Within-School Switching on Math Achievement 


M1 
Constant (Omitted= Yr Prior to Switch) 0315 "2" 
(0.007) 
Dummy: 1= Year Switched (any type) -0.020 *** 
(0.001) 
Dummy: 1= 1 Yr(s) After Switched (any type) 0.002 
(0.002) 
Dummy: 1= 2 Yr(s) After Switched (any type) 0.007 ** 
(0.002) 
Dummy: 1= 3+ Yr(s) After Switched (any type) 0.005 * 
(0.002) 
R-squared 0.649 
N 1146914 
Fixed Effects? -- 


M2 


0.348 *** 


(0.011) 


=0.019,"** 


(0.002) 


0.004 
(0.002) 


0.004 
(0.003) 


0.002 
(0.003) 


0.687 


1146914 
Teacher 


M3 M4 
0.431 *** 0.390 *** 
(0.009) (0.009) 
-0.022 *** -0.021 *** 
(0.001) (0.001) 
0.003 0.005 ** 
(0.002) (0.002) 
0.007 ** 0.008 *** 
(0.002) (0.002) 
0.005 * 0.003 
(0.002) (0.003) 
0.654 0.662 
1146914 1146914 
School Schx Grade 


M5 
0.398 *** 
(0.010) 


-0.023 *** 
(0.002) 


0.005 ** 
(0.002) 


0.015.4** 
(0.002) 


0.025:*** 
(0.003) 


0.665 


1146914 
Sch x Year 


M6 
OBIS 
(0.012) 


-0.021 *** 
(0.002) 


-0.004 * 
(0.002) 


0.008 *** 
(0.003) 


0.015 *** 
(0.003) 


0.909 


1146914 


Student 


Sample: Teacher-year observations that occur one year prior to a teacher’s first within-school switch and one before a second switch 
occurs. All models shown here have time-varing and time-invariant student characteristics, aggregated time-varying classroom covariates, 


teacher time-invariant and time-varying characteristics, and school time-invariant and time-varying characteristics (except when collinear 
with the relevant fixed effects). The constant in these models is not directly interpretable given the variety of time-varying and time- 


invariant student, teacher, classroom covariates and the hold-one-out reference categories for the relevant teacher fixed effects. 
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Table 10. Number and Percentage of Switch Types in Other (Non-NYC) New York State Districts, by Average 
District Size and Urbanicity 
New to 
Teaching New to District New to 
No Switch Profession (Not Teaching) Newto School _ Assignment Row Total 
Average District Enrollment 


< 10k 1,671,740 165,520 75,153 151,999 341,709 2,406,121 
(69.5) (6.9) (3.1) (6.3)" (14.2) (100.0) 

10- 20k 964,465 79,173 34,973 109,983 212,599 1,401,193 
(68.8) (5.7) (2.5) (7.8)" (15.2) (100.0) 

20- 50k 505,163 41,446 14,750 70,733 118,008 750,100 
(67.3) (5.5) (2.0) 9.4)" (15.7) (100.0) 

50-100k 159,484 16,210 2,959 33,468 49,732 261,853 
(60.9) (6.2) (1.1) (12.8)" (19.0) (100.0) 

> 100k 78,028 T8 940 19,481 19,844 126,021 
(61.9) (6.1) (0.7) (15.5) (15.7) (100.0) 

District Urbanicity Code 

city 365,513 35,613 7,533 68,124 98,132 574,915 

° (63.6) (6.2) (1.3) (11.8)" (17.1) (100.0) 

suburb 579,723 172,784 84,703 221,979 130,679 1,189,868 

‘ (68.2) (5.9) (2.9) (7.6)" (15.4) (100.0) 

town 2,078,788 38,622 13,169 39,715 394,203 2,564,496 

7 (71.1) (6.5) (2.2) (6.7)" (13.5) (100.0) 

rural 415,135 62,605 23,199 55,693 79,354 635,985 

(70.0) (7.4) (2.7) (6.6) (13.4) (100.0) 

NYC TOTAL 1,143,400 124,690 50,004 201,838 433,682 1,953,614 
(58.5) (6.4) (2.6) (10.3) (22.2) (100.0) 
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Figures 


Figure 1. Distribution of Ratio of This Year’s Switches to Last Year’s Departures, across School- Years 


Median=3.38 


1?) 
= 
= 
= 
oO 
5 
72) 
Q 
O 
— 
Ze 
~_ 
= 
[S) 
” 
ks: 
#* 


Figure 2. Distribution of Within-School Switch Rates across New York State Districts with at least 10,000 
Students (Outside of New York City) 


Distribution of Within-School Switch Rates Across New York State Districts 
(Sample: Districts with At Least 10,000 Students on Average) 
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Appendix A: Definitions of Switching 


New York State tracks movements of teachers across schools from one year to the next using an 
annual reporting survey called the Personnel Master File (PMF), making it possible to observe when 
teachers are new to New York City, new to the profession, new to a given school, or new to a teaching 
assignment within the same school. However, characterizing within-school subject and grade switches is 
less straightforward than it might initially seem. We base switch behavior on the PMF data reported by 
teachers annually. Two factors complicate our attempt to identify each teacher’s change in within- 
school subject-grade assignment from one year to the next. In the PMF, teachers are asked to report all 
of their teaching assignments, and 35 percent of teachers in the PMF are assigned to more than one role 
each year. For the 65 percent of teacher-years with exactly one assignment, it is straightforward to 
identify a primary subject and grade. For the other 35 percent, the primary role may be less clear. 
Fortunately, teachers also report the percentage of their time dedicated to each role. For the purposes 
of this paper, we therefore use the teacher’s role with the greatest percentage of time as their observed 
“primary” subject-grade role. Using this approach, we can identify both a primary subject and grade for 
79 percent of the teacher-year observations. However for the other 21 percent, time is split equally 
across multiple roles or information is idiosyncratically missing about either subject or grade level. These 
observations are omitted from the primary impact analyses in this paper, though we conduct bounding 
exercises that do include these observations—more on this below. 

Changes in assignments from one year to the next are much more continuous than one variable 
can perfectly capture. The decision to identify a single “primary” subject and grade may overestimate 
the prevalence of switching since a teacher whose allocation of time shifts (but course load does not) 
could be characterized as experiencing a “switch” even though the only thing that has actually changed 


is which of her roles takes most of her time. In order to address this concern, we also explored the use 


of other, more conservative definitions of within-school assignment switches.?° However, the vast 
majority—88 percent—of the teacher-year observations are not subject to this source of ambiguity 
about within school reassignments—either because they are new to teaching (so we are certain they are 
new to their assignment), new to their school (so we are certain they are not churning within the 
school), or because they have exactly one subject and grade assignment and therefore role switches are 
straightforward. For the remaining 12 percent, definition of subject/grade assignment could matter. Our 
most conservative definition identifies 26 percent of those ambiguous cases as switches, while our less 
conservative definition based on primary subject and grade identifies 32 percent of those ambiguous 
cases as switchers. However, in the larger context of all teacher-year observations, it only changes our 
overall estimate of the frequency of within school-churn by 1 to 3 percentage points. 

Therefore, while we acknowledge that the reduction of multiple assignments per year to a 
single, primary assignment in each year likely overestimates the rate of within-school churn by a small 
amount, the effect of that decision on our estimate of the overall frequency of within-school churn 
appears to be quite small. Furthermore, the use of the primary subject/grade approach should also 
attenuate the estimated effect of switching, since the binary version of the variable—if anything— 
exaggerates the extent to which teachers roles may change from one year to the next. We also perform 
a bounding exercise in which we make assumptions about the switching behaviors about those omitted 
teacher-years and include them in the analyses. 

The second complication with identifying a primary subject-grade assignment change arises due to the 


nature of subject/role names in the dataset. In the PMF, there are 4,329 unique role descriptions (e.g., 


‘0 Ror instance, we examined the following, more conservative definition of subject/ grade switching: A within- 
school grade switch occurs if and only if there is no overlap between all the grades taught by a given teacher in the 
current year and all the grades taught by that teacher in the previous year. Under this definition, a teacher who 
taught 6" and 7" grade math last year, and 7 and 8" grade math this year would not be identified as switching, 
because some of the grades she taught last year overlap with the grades she taught this year. While this definition 
does decrease the number of teachers who were identified as switching (from 32 percent of all switches are within- 
school to 26 percent), the percentage of all teachers for whom such ambiguity exists (i.e., 6 percent of the 12 percent 
with ambiguity) is sufficiently small to have no substantive impact on the results presented in the paper. 


elementary teacher, creative writing, drama, physical education, first year algebra, advanced algebra, 
school counselor, European culture studies). Therefore we were concerned that even small changes in 
the name of a role might have appeared to be a “switch” when in fact it is not. We therefore categorize 


those unique roles into 15 categories—see Appendix Table A1. 


Appendix Table Al. Fifteen Categories of Assignment based on Original Course/Role Titles, 
Frequency and Percent of Both Person- Year Observations (Left) and Unique Couse/Role Titles 


Person- Year Observations Unique Course Titles 
Number Percent Number Percent 
elem _1,864,956 25.5% 11 0.3% 
admin —«‘1,023,551 14.0% 930 21.5% 
special 781,211 " 10.6% 499 " 11.8% 
ela 663,824 9.1% 95 2.2% 
math 444,569 * 6.0% 253 ° 6.0% 
fine art 441,101 6.0% 354 8.2% 
science 406,629 ” 5.5% o75 * 6.5% 
social studies 396,948 5.4% 216 5.0% 
phys/health ed 362,356 * 4.9% 80" 1.9% 
cte 336,715 4.6% 1,089 25.2% 
foreign lang 210,688 ” 2.9% 374 7 8.9% 
other 160,857 2.2% 90 2.1% 
esl 137,621 " 1.9% 507 1.2% 
library 95,588 1.3% 13 0.3% 
7,326,614 100.0% 4,329 100.0% 


Most (71 percent) of teacher-year subject/roles were easily categorized into either ELA, math, 
elementary, social studies, science, fine arts, or administrative. Other categories included 
physical/health education, career/technical education, foreign language, etc. All administrative roles 
(e.g., principals, assistant principals) were collapsed into a single role called “admin.” For about 2.2 
percent of all observations, we had no clear subject to which the role belonged (e.g., course titles that 
said “other”, driver education, study skills, safety education, cooperative work experience), and we 


categorized these remaining observations as simply as “other.” 


One might be concerned that distilling the long list of role descriptions into 15 categories could 
rely too heavily on researcher discretion, however the vast majority of role names were clear 
permutations of a given category. In fact, though there are over 4,000 unique permutations of role 
descriptions in the original dataset, the majority of observations use a much smaller subset of very 
common role descriptions (see Appendix Figure A1). For instance, over 50 percent of all the 
observations in the dataset can be accounted for using just the 68 most common descriptors (75 
percent using the top 250 descriptors, and 90 percent using the top 652 descriptors). Therefore the 
challenge of collapsing the unique role descriptions into 15 categories is more straightforward than it 


may initially seem. 


Appendix Figure Al. Rank Order of Most Common Role Descriptors, by Cumulative Percentage 
of Observations that Use Those Top Descriptors 


Percentage of Observations With Each Assignment Title 
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In order to collapse the role descriptions into these 15 categories, we use a series of regular 
expressions based on PMF codebooks and then manually checked that all the role descriptions allocated 
to a given category seemed appropriate. In Appendix Table A2, we present the top most common role 


descriptions within each of the 15 categories, along with the percentage of observations within that 


category with the given role description. We either present the roles descriptions that comprise the top 
50 percent of all role descriptions within the category or, in cases where fewer than five roles accounted 
for greater that 50 percent of the roles descriptions in the category, we opted to list at least the top five 
most common role descriptions. This allows the reader to examine the success of translating role 
descriptions into fifteen meaningful categories. 

As one can see from Appendix Table A2, certain categories were particularly straightforward. 
For instance, elementary classrooms are near-universally indicated with the term “Common Branch” in 
the dataset. Likewise, the ELA category was particularly straightforward: Though we report in Appendix 
Table A1 that 95 role descriptions are categorized as “ELA”, we can also see from Appendix Table A3 
that over 50 percent of all the ELA descriptions are covered by only six main ones (English 6, 7, 8, 9, 10 
and 11). Other categories had more variability in their descriptors (for example, there are many “admin” 
roles, and many different “cte” roles), however the match between descriptors and categories seems 


quite successful in terms of thematic correspondence. 


Appendix Table A2. Fifteen Categories of Role Type based on Course/Role Titles, Frequency 


and Percentage 


Subject=elem: 

COMMON BRANCH-GRADES 1-6 
COMMON BRANCH (GRADES 1-6) 
KINDERGARTEN 

COMMON BRANCH - GRADES 1-6 
COMMON BRANCH _ GRADES 1-6! 


Subject= ela: 
ENGLISH 3 
ENGLISH 7 
ENGLISH 8 
ENGLISH 10 
ENGLISH 11 
ENGLISH 6 


Subject=math: 


MATH? 
MATHS 
MATHE 
REMEDIAL MATHEMATICS 

3 YR SEQ-COURSE I-REGENTS 
OTHER MATHEMATICS 
3YR SEQ-COURSE Il- 1 YEAR 


Subject=esl: 

ENGLISH 4S 4 SECOND LANG [K-6) 
ENGLISH 4S 4&4 SECOND LANG[?-12) 
SPANISH BILINGUAL ED (K-6) 
SPANISH BILINGUAL ED (7-12) 
BILINGUAL EDUC (COMMON BR K-6: 


Subject=social studies: 
GRADE 7:US&NY HIST 
GRADE 8:US& NY HIST 
EUROPEAN CULTURE STUDIES 
AMERICAN STUDIES 

USHIST & GOVERNMENT 
GLOBAL STUDIES 3 

GLOBAL STUDIES 10 

UNITED STATES HISTORY (JHS) 


Subject=physthealth ed: 
PHYSICAL EDUCATION 

PHYSICAL EDUCATION GRADES 7-12 
PHYSICAL EDUCATION GRADES K-6 
PHYSICAL EDUCATION K-12 

HEALTH ED(GR9-12,1#2 UNIT COU) 


Subject=science: 
BIOLOGY-REGENTS 

LIVING ENVIRONMENT/BIOLOGY-REG 
LIFE SCIENCE- GR7,8,0R9 

GENERAL SCIENCE - JR HIGH 
PHYSICAL SCIENCE-GR 7,8, OR 9 
OTHER SCIENCE 

PHYSICAL SETTINGfEARTH SCIENCE 
CHEMISTRY- REGENTS 

EARTH SCIENCE-REGENTS 

BIOLOGY (REGENTS) 

GENERAL SCIENCE 7 
PHYSICS-REGENTS 

GENERAL SCIENCE 3 

GENERAL SCIENCE-GR 7,8,0R 9 
GENERAL SCIENCE 8 

LIFE SCIENCE- GR 5,6,7 OR 8 

ELEM SCIENCE(K-6 STATE SYLLAB 


Subject=fine art: 
ELEMENTARY MUSIC K-6 
ART (PK-6) 

INSTRUMENT CLASS 
ELEMENTARY ART (K-6) 
ELEMENTARY MUSIC (K-6) 
ART 7&8 


STUDIO ART:COMP FOUNDATION CRS 
EXPLORING VISUAL ARTS (GR 7-8) 
STUDIO IN DRAWING AND PAINTING 
ELEMENTARY ART 

INDUSTRIAL ARTS GRADE 8 


Subject=foreign lang: 
SPANISH FIRST UNIT STUDY (7-3) 
SPANISH HIGH SCHOOL LEYEL II 
SPANISH HIGH SCHOOL LEVEL! 
SPANISH HIGH SCHOOL LEVEL Ill 
SPANISH SEC UNIT STUDY (7-3) 
FRENCH FIRST UNIT STUDY (7-3) 


SPANISH Ill 

FRENCH HIGH SCHOOL LEVEL II 
SPANISH FIRST UNIT STUDY (K-68) 
SPANISH HIGH SCHOOL LEVEL Iv 
SPANISH Il (9-12) 


Subject=library: 

LIBR MEDIA SP?TEACHER OF LIBR 
LIBRARIAN/LIBRARY MEDIA SPEC 
LIBR MEDIA SP/LIBRARISNITCH OF 
LIBRARY TEACHER 

LIBRARY 


Subject= special: 

SPECIAL ED RESOURCE ROOM- ELEMENTARY 
TCH OF SPEECHIHESRING IMPAIRED 

SPECIAL ED RESOURCE ROOM - SENIOR HIGH 
SPECIAL CLASS (SR HS) 15:1 

SPECIAL ED CONSULTANT TEACHER - ELEM 
SPECIAL ED RESOURCE ROOM - MIDDLEHWJR. HS 
CORRECTIVE SPEECH NOT SPEC ED 

SPECIAL ED RESOURCE ROOM MIDISEC 7-12 
SPECIAL CLASS(MIDDLE?JHS) 15:1 

SPECIAL ED CONSULTANT TEACHER MIDISEC 7?- 
SPECIAL ED CLASS-HS 

SPECIAL ED CLASS (SR HS) 12:1+1 

SPECIAL ED CLASS - ELEM 12:1+1 

SPEC ED CLASS-MIDDLEMJHS 12:1+1 

SPECIAL ED OF SPEECHILANG DISABLED 
SPECIAL ED CONSULTANT TEACHER - HS 
SPECIAL ED CONSULTANT TEACHER-MIDDLE/JF 
SPECIAL ED LEARNING DIS-RESOURCE RM-ELEN 
SPECIAL ED CLASS - ELEM 15:1 

SPECIAL ED SPEECH IMP-RESOURCE RM-ELEM 
SPECIAL ED CLASS K-6 

LEARNING DISAB-SPEC ED CLASS-HS 


Subject= other: 

OTHER SUBJECT AREA 
COMPUTER STUDIESHINSTR [K-6) 
COMPUTER STUDIESHINSTR (7-12) 


HELPING 
STUDY SKILLS 


Subject= admin: 

SCHOOL PSYCHOLOGIST 
PRINCIPAL ELEMENTARY SCHOOL 
SENIOR HIGH SCHOOL COUNSELOF 
SCHOOL NURSE 

SCHOOL SOCIAL WORKER 

OTHER GENERAL STAFF 

ASST PRINCIPAL SENIOR HIGH SCF 
ASST PRINCIPAL ELEMENTARY SC 
MIDDLE SCHOOL COUNSELOR 
SCHOOL NURSE-TEACHER 
ELEMENTARY SCHOOL COUNSELO 
OTHER PUPIL PERSONNEL SERVIC! 
SUPERINTENDENT 

PRINCIPAL SENIOR HIGH SCHOOL 
SECONDARY SCHOOL COUNSELOF 


ASST PRINCIPAL MIDDLE SE 


OTHER SUBJECT AREA ADMINIST! 
OTHER 4DMIN-OTHER SUBJECT AF 
PSYCHOLOGY-ELECTIVE 
PRINCIPAL MIDDLE SCHOOL 


Subject=cte: 

INTRO TO TECHNOLOGY - GRADE 8 
INTRO TO TECHNOLOGY - GRADE 7 
HOME/CAREER SKILLS - GRADE 7 
HOME/CAREER SKILLS - GRADE 8 
TYPEWRITING 1 (FIRST YEAR) 
KEYBOARDING | (72 UNIT) 

OTHER BUSINESS 

HOME ECONOMICS - GRADE 8 
HOME ECONOMICS - GRADE 7 
FOOD AND NUTRITION 
KEYBOARDING BUS COMM I(1UN) 
HOME/CAREER SKILLS - GRADE 6 
MANUAL SHORTHAND 1 

OTHER HOME ECONOMICS 
woods 

BUSINESS LAW 

INTRO TO TECHNOLOGY - GRADE 6 
ACCOUNTING (1 UNIT) 
INTRODUCTION TO OCCUPATIONS 
KEYBOARDING 

TYPEWRITING (PERSONAL) 

FOOD AND NUTRITION CORE 
BUSINESS LAww (1UNIT) 
TYPEWRITING |-FIRST YEAR 

HOME ECONOMICS GRADE 7 
HOME ECONOMICS GRADE 3 
BOOKEEPING/ACCTG 1(FIRST YR) 
DESIGN & DRAW FOR PROD(1 YEAR 
METALS 

4UTO MECHANICS 

BUSINESS ARITH (AND APPLIED) 
GEN BUS (INTRO TO BUS) 

TEXTILES AND CLOTHING 

OTHER TECHNOLOGY EDUC (1 YEAF 
TECHNICAL DRAWING 

BUSINESS COMP APPL [1/2 UNIT) 
WOODS (1 YEAR) 

INTRO TO BUSINESSIMARKETING 
HE 1- PERSONAL 4ND CHILD DEY 
COSMETOLOGY 

BKPGIACCTNG 1-FIRST YEAR 

OFF PRAC 1(FST YROR MACH OP) 
PROGRAMMING 
ELECTRICITY-ELECTRONICS 
OTHER BUSINESS SUBJECTS 

ELEC INFO PROC(OFF PROC) (1UN. 


Cum 
6.18 
1.8 
16.17 
19.94 
23.69 
26.43 
29.07 
31.62 
33.67 
35.72 
37.75 
39.7 
4134 
42.88 
444 
45.69 
46.97 
48.12 
49.26 


Cum 
3.99 
7.62 
1 
13.6 
15,71 
17.62 
19.14 
20.62 
22.07 
23.4 
24.58 
25.7 
26.81 
27.87 
28.92 
29.92 
30.89 
31.85 
32.81 
33.75 
34.64 
35.5 
36.33 
S714 
37.91 
38.67 
39.41 
40.13 
40.83 
4153 
42.22 
42.89 
43.54 
44.19 
44.75 
45.27 
45.8 
46.3 
46.79 
47.27 
4774 
48.21 
48.68 
49.14 

49.59 


Two subject-specific categories are worth mentioning in greater detail: “Special Education” and 
“ESL” subjects. On the one hand, these roles might not be conceived of as mutually exclusive categories 
relative to, for example, an elementary classroom teacher role. That is, a teacher could be assigned to 
an elementary classroom of for students with English as a Second language. Indeed, of those 
observations coded as subject = “ESL”, 76 percent serve students in grades K-6, perhaps suggesting that 
these tend to be elementary classrooms. The same can be said for assignments categorized as “special 
education” (there is greater diversity in terms of the grade levels of classrooms designated special 
educations). We were left with a decision about whether to try to define role descriptions that clearly 
indicated they were specific to one of these two populations based on their content or based on the 
population they served. 

The PMF file instructs teachers to use unique, dedicated assignment codes when serving 
students with disabilities are to report an assignment using a special education program code." 
Likewise, a set of unique codes exist for courses designated English as a Second Language.’? We 
therefore follow the State’s decision to separate these groups into their own assignment categories, 
despite the fact that many of these classrooms are also either elementary classrooms or classrooms 
dedicated to certain subject areas, as well. 

In addition, in thinking about the nature of teachers switching assignments, we believe it would 
be a meaningful change in terms of instructional experience to move from/to a class that was 
designated for a specific subpopulation of students with particular pedagogical needs and curricular 
changes. We therefore opt to code these as distinct categories, separate from other kinds of classroom 
responsibilities. Finally, many of the role descriptions are explicit about working with a specific 


population but are less clear about content area. For these reasons together, we opted to categorize 


'! (See example of instructions at 
http://www.p12.nysed.gov/irs/beds/2014/PMF/documents/ePMFTeachingManualUserGuide201516.pdf) 
 http://www.p12.nysed.gov/irs/beds/2014/PMF/documents/TeachingCodes2015-16.pdf 


both role descriptions that are designated ESL or special education as separate subject categories. We 
can therefore examine the frequency of teachers switching between assignments that are and are not 
specific to working in these contexts. 

As a final check on the validity of the PMF assignment data, we examined the set of teachers 
with value-added scores, because these teachers go through a roster verification process to ensure that 
teachers are appropriately linked to the correct students in the correct subject for evaluation purposes. 
Those teachers are either categorized as teaching math only, ELA only, or both (i.e., an elementary 
school whole-classroom teacher). Among those teachers who are designated “math only” teachers 
according to roster verification for producing value-added estimates, 87.9 percent were also categorized 
as “math” subject teachers according to the PMF coding (5 percent were categorized as “elementary” 
teachers according to the PMF, and about 2 percent were categorized as ESL or special education 
teachers according to the PMF). Results were quite similar among “ELA only” teachers. This suggests a 
high level of correspondence between the two sources of information about teacher subject 
assignments. 

Though it is beyond the scope of the current paper to fully describe the modal types of within- 
school switches that take place, it may be relevant to examine these when thinking about subsequent 
analyses. In Appendix Table A3, we examine separately the percentage of observations in each grade- 
level (top panel) or subject-level (bottom panel) category from the prior year and report in column 1 the 
percentage of that categories that experiences a grade- or subject-level switch from prior to current 
year. In columns 2, 3, and 4, we present the modal categories into which these observations switch. For 
example, among all teachers who were in grade K in the prior year, 17.2 percent switched to a different 
grade level in the current year. Of those, the most common grade that these teachers switched into was 
Grade 1 (55.8 percent), followed by grade 2 (21.7 percent), and followed by grade 3 (9.2 percent). 


Findings are particularly relevant by prior subject. Whereas most personnel who were administrators 


last year switch into a new subject in the next year, only about 8 percent of teachers who were 


designated in an “elem” classroom in the prior year switch into a different subject the following year. 


Appendix Table A3. Rates of Subject and Grade-Level Switches from Prior to Current Year, and 


Top Three Most Common Categories Switched Into 


Teachers' Grade Level Prior Year to Grade Level Current Year 


Percent That 1st Most Common 2nd Most Common 3rd Most Common 
Grade Level Switch Grades Grade Switched to in Grade Switched to in Grade Switched to in 
Prior Year in Next Year Current Year (and %) Current Year (and %) Current Year (and %) 
K 17.2% 1 (55.8%) 2 (21.7%) 3 (9.2%) 
1 23.0% 2 (42.4%) K (26.8%) 3 (14.6%) 
2 27.2% 3 (33.3%) 1 G0.7%) K (12.9%) 
3 28.0% 4 (34.4%) 2 (26.4%) 5 (13.9%) 
4 28.3% 5 (36.3%) 3 (28.3%) 2 (12.4%) 
5 27.2% 4 (32.1%) 6 (27.7%) 3 (16.9%) 
6 29.6% 7 37.3%) 5 (20.8%) 8 (17.8%) 
7 38.0% 8 (62.3%) 6 (20.2%) 9 (11.0%) 
8 34.7% 7 (57.0%) 6 (18.2%) 9 (17.9%) 
9 39.8% 10 (45.4%) 11 7.6%) 8 (13.5%) 
10 43.2% 9 (47.4%) 11 34.4%) 12 (13.6%) 
11 45.7% 10 (41.6%) 12 (27.9%) 9 (27.4%) 
12 43.6% 11 42.5%) 10 (31.2%) 9 (22.9%) 
Teachers' Subject Prior Year to Subject Current Year 
Percent That 1st Most Common 2nd Most Common 3rd Most Common 
Subject/Role Switch Subjects Subject Switched to in Subject Switched to in Subject Switched to in 
Prior Year in Next Year Current Year (and %) Current Year (and %) Current Year (and %) 
admin 79.7% elem (16.5%) ela (16.4%) social studies (15.9%) 
other 50.0% elem (52.5%) ela (10.0%) special (6.9%) 
library 32.7% elem (69.6%) ela (13.0%) other (6.4%) 
esl 22.1% elem (58.5%) foreign lang (9.3%) ela (9.1%) 
fine art 19.0% elem (39.1%) cte (16.9%) ela (13.1%) 
cte 15.7% other (19.1%) math (16.1%) fine art (15.6%) 
phys/health ed 15.7% elem (32.9%) science (15.5%) cte (8.0%) 
ela 13.0% elem (39.8%) social studies (14.4%) special (11.1%) 
special 12.8% elem (34.0%) ela (20.1%) other (8.5%) 
foreign lang 11.4% esl (30.6%) elem (20.0%) ela (13.2%) 
science 10.8% elem (30.6%) math (14.5%) social studies (13.9%) 
math 9.6% elem (26.8%) other (13.2%) science (13.1%) 
social studies 8.7% ela (26.6%) elem (16.4%) science (13.6%) 
elem 8.1% other (25.3%) esl (23.4%) ela (19.3%) 


In summary, when thinking about how to capture subject switches, we sought to balance our 
approach both by being specific enough to capture meaningful changes in the teacher’s instructional 
responsibilities, but also not too specific to pick up on often small distinctions in role descriptions. We 
anticipate that the reduction of role descriptions to only fifteen subject categories likely leads to an 
underestimate of the frequency of within-school churn. For instance, a teacher who teaches Geometry 
in one year but switches to Algebra II in the following year will not be categorized as having a subject- 
switch, because both would be counted as teaching the subject of “math.” This decision rule implies that 
we may be under-reporting within-school switches, something worth keeping in mind given that the 
frequency of churn even under this conservative assumption is surprisingly high. In addition, this 
decision rule means that the within-school switches at the heart of the current analyses represent quite 
fundamental changes in role—for instance, from teaching science to teaching math (history to ELA, ELA 


to math, etc.). 
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Appendix B: Estimating Teacher Value-Added Scores 


Although there is no consensus about how best to measure teacher quality, this paper measures 
teacher effectiveness using a value-added framework in which teachers are judged by their ability to 
stimulate student standardized test score gains. While imperfect, these measures have the benefit of 
directly measuring student learning and they have been found to be predictive of other measures of 
teacher effectiveness such as principals’ assessments and observational measures of teaching practice 
(Atteberry, 2011; Grossman et al., 2010; Jacob & Lefgren, 2008; Kane & Staiger, 2012; Kane, Taylor, 
Tyler, & Wooten, 2011; Milanowski, 2004), as well as long term student outcomes (Chetty, Friedman, & 
Rockoff, 2011). We estimate teacher-by-year value-added employing a multi-step residual-based 
method similar to that employed by the University of Wisconsin’s Value-Added Research Center (VARC). 
VARC estimates value-added for several school districts, including until quite recently New York City. 

We initially estimate Equation (A), which regresses achievement (Yicspy) for student i in class c 
at school s taught by teacher p in year y as a function of prior achievement (Yics jpy—1), Student 
attributes (Xicspy), and class fixed effects (@ spy). In this model, the class fixed effects subsumes both 
the teacher-by-year fixed effect (T,,,) and any other class (Z,5y,) or school-level (S;,,) predictors of 
student achievement. 

Yiespy = Mics jpy—1 + B’Xtespy a Acspy T; Eicspy (A) 
where Qcspy = Y Zespy + O'Ssy + Tyy 

We calculate the residuals (€ic¢spy) from this regression without accounting for @ spy and then 
estimate Equation (B) which regresses this residual on class and school characteristics as well as a class 


random effect (¢,,) to reflect the grouping of students into classrooms. 


Eiespy = Acspy + Eicspy = Y Zespy - Q'Ssy a Spy + Wicspy (B) 
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We calculate the residuals (dicspy) from this model and calculate teacher-by-year value-added 


by averaging across the student-level residuals within a teacher and year. 


Ty = dicspy (C) 

The teacher-by-experience fixed effects become the value-added measures which serve as the 
outcome variable in our later analyses. They capture the average achievement of teacher p’s students in 
year y, conditional on prior skill and student characteristics, relative to the average teacher in the same 
subject and grade. Finally, we apply an Empirical Bayes shrinkage adjustment to the resulting teacher- 
by-year fixed effect estimates to adjust for measurement error. 

In the teacher-by-year value-added model presented above we make several important analytic 
choices about model specification. Our preferred model uses a lagged achievement as opposed to 
modeling gain scores as the outcome). The model attends to student sorting issues through the 
inclusion of all available student covariates rather than using student fixed effects, in part because the 
latter restricts the analysis to comparisons only between teachers who have taught at least some 
students in common.?? At the school level we also opt to control for all observed school-level covariates 
that might influence the outcome of interest rather than including school fixed effects, since this would 


also only allow valid comparisons within the same school. 


'3 A student fixed effects approach has the advantage of controlling for all observed and unobserved time-invariant 
student factors, thus perhaps strengthening protections against bias. However, the inclusion of student-level fixed 
effects entails a dramatic decrease in degrees of freedom, and thus a great deal of precision is lost (see discussion in 
McCaffrey, Sass, Lockwood, & Mihaly, 2009). In addition, experimental research by Kane and Staiger (2008) 
suggests that student fixed effects estimates may be more biased than similar models using a limited number of 
student covariates. 
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Appendix C: Bounding Exercise on Main Findings 


Recall that, for about 20 percent of the person-years in the dataset do not have a clear 
“primary” subject-grade level assignment. We conduct a bounding exercise related to these ambiguous 
teacher-year observations and find that our findings are generally robust to the various assumptions one 
could make about the status of those unknown cases (see Appendix C for descriptive of approach and 
presentation of results). 

A small percentage of this occurs due to missing data, but this primarily occurs when teachers 
have more than one subject or grade-level assignment and no one of those assignments makes up a 
clear majority of their time. In order to explore the role of this ambiguity, we conduct a bounding 
exercise in which we first assume that all person-year observations missing information about switch 
status are non-switchers. We re-estimate the same regression model now with these missing 
observations included as individuals who do not churn within schools. To bound at the other end, we 
also make the assumption that all missing observations were in fact within-school churns and re-run the 
same analyses. We would be especially concerned if the estimated impact of switching were positive 
under some of these assumptions but negative for others. This would suggest that our results may be 
sensitive to the missing data problem and could be swayed in either direction if the missing data were in 
fact not missing. The bounding exercise results for math in (Appendix Table C1 and C2) shows that 
results are not sensitive to these assumptions, remaining negative and statistically significant for all 


three switch types and all models. 
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Appendix Table Cl. Bounding Exercise: Assume All Teachers with Ambiguous Switch Status Did 
Switch 


MATH 

Mi M2 M3 M4 M5 M6 
New to Teaching —__(9.069 * -0.061 *** -0.072 *** -0.071 *** -0.075 *** -0.076 ** 
Profession (0.002) (0.002) (0.002) (0.002) (0.002) (0.002) 
New to NYC -0.045 * -0.037 #2 -0.043 -0.044 *## -0.046 ** -0.063 ** 
(Not Profession) —_((),003) (0.004) (0.003) (0.003) (0.003) (0.003) 
Switched from -0.051 * -0.030 *** — -0.050 *** 0.050 #** 0,054 ** -0.054 ** 
Other Sch (0.002) (0.002) (0.002) (0.002) (0.002) (0.002) 
Switched Within — 9,014 *** -0.010 *** -0.017 *** -0.017 *** -0.017 ** -0.015 *** 
Same Sch (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) 
R-squared 0.655 0.688 0.658 0.665 0.668 0.886 
Num Teachers 23022 23022 23022 23022 23022 23022 
Num Obs. 1650195 1650195 1650195 1650195 1650195 1650195 
Fixed Effects? -- Teacher School Sch x Grade Sch x Year Student 

ELA 

M1 M2 M3 M4 M5 M6 
New to Teaching (9.942. *** -0.034 *#* -0.042 *** -0.042 *** -0.043 ** -0.044 ** 
Profession (0.002) (0.002) (0.002) (0.002) (0.002) (0.002) 
New to NYC -0.024 *** —— -0,009 * -0.022 *** — -0,024 *** ——-0,022 ** -0.026 ** 
(Not Profession) —_((),003) (0.004) (0.003) (0.003) (0.003) (0.004) 
Switched from -0.012 *** -0.006 * -0.016 *** -0.015 *** -0.021 ** -0.020 ** 
Other Sch (0.002) (0.003) (0.002) (0.002) (0.002) (0.002) 
Switched Within —__9.903 ** 0.000 -0.007 *** -0.006 ** -0.009 *** -0.012 ** 
Same Sch (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) 
R-squared 0.585 0.604 0.587 0.591 0.595 0.845 
Num Teachers 23654 23654 23654 23654 23654 23654 
Num Obs. 1653675 1653675 1653675 1653675 1653675 1653675 
Fixed Effects? -- Teacher School Sch x Grade Sch x Year Student 


All models shown here have time-varing and time-invariant student characteristics, aggregated time-varying 
classroom covariates, teacher time-invariant and time-varying characteristics, and school time-invariant and time- 


varying characteristics (except when collinear with the relevant fixed effects). 
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Appendix Table C2. Bounding Exercise: Assume All Teachers with Ambiguous Switch Status Did 
Not Switch 


MATH 

Mi M2 M3 M4 M5 M6 
New to Teaching —__(9. 068 ** -0.061 *** -0.070 *** -0.069 *** -0.073 *** -0.074 ** 
Profession (0.002) (0.002) (0.002) (0.002) (0.002) (0.002) 
New to NYC -0.044 ** -0.036 *** -0.041 *** -0.042 *** -0.044 *** -0.061 ** 
(Not Profession) —_ (003) (0.004) (0.003) (0.003) (0.003) (0.003) 
Switched from -0.050 ** -0.029 *** —-0.049 *#** 0,048 *** 0,052 *** = -0.053 ** 
Other Sch (0.002) (0.002) (0.002) (0.002) (0.002) (0.002) 
Switched Within = 0.015 *** —--0.010 *** = --0.016 *** = -0.015 *** = -0.015 *** =~ -0.014 *** 
Same Sch (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) 
R-squared 0.655 0.688 0.658 0.665 0.668 0.886 
Num Teachers 23022 23022 23022 23022 23022 23022 
Num Obs. 1650195 1650195 1650195 1650195 1650195 1650195 
Fixed Effects? -- Teacher School Sch x Grade Sch x Year Student 

ELA 

M1 M2 M3 M4 M5 M6 
New to Teaching (9.942. *** -0.034 *** -0.042 *** -0.042 *** -0.042 ** -0.043 ** 
Profession (0.002) (0.002) (0.002) (0.002) (0.002) (0.002) 
New to NYC -0.024 *** —— -0,009 * -0.022 *** —--0,024 *** ——-0,022 ** -0.025 ** 
(Not Profession) —_((),003) (0.004) (0.003) (0.003) (0.003) (0.004) 
Switched from -0.011 *** -0.006 * -0.016 *** -0.015 -0.021 ** -0.019 ** 
Other Sch (0.002) (0.003) (0.002) (0.002) (0.002) (0.002) 
Switched Within =—_9.004. #** -0.001 -0.006 ** -0.006 * -0.009 *** -0.011 ** 
Same Sch (0.001) (0.001) (0.001) (0.001) (0.001) (0.001) 
R-squared 0.585 0.604 0.587 0.591 0.595 0.845 
Num Teachers 23654 23654 23654 23654 23654 23654 
Num Obs. 1653675 1653675 1653675 1653675 1653675 1653675 


Fixed Effects? -- Teacher School Sch x Grade Sch x Year Student 
All models shown here have time-varing and time-invariant student characteristics, aggregated time-varying 
classroom covariates, teacher time-invariant and time-varying characteristics, and school time-invariant and time- 


varying characteristics (except when collinear with the relevant fixed effects). 
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